Jul 15 16:38:03.993689 ip-10-0-135-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 16:38:03.993703 ip-10-0-135-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 16:38:03.993714 ip-10-0-135-165 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 16:38:03.994044 ip-10-0-135-165 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 16:38:14.242707 ip-10-0-135-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 16:38:14.242726 ip-10-0-135-165 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot aefebc7d0d4a489180c8de264b2e7ec4 --
Jul 15 16:40:13.312099 ip-10-0-135-165 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.738157    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743534    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743548    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743552    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743555    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743558    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743562    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743565    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:13.875487 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743568    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:13.823836 ip-10-0-135-165 systemd[1]: Started Kubernetes Kubelet.
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743571    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743574    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743578    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743581    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743585    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743588    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743591    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743594    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743598    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743601    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743603    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743606    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743609    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743612    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743617    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743620    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743623    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743628    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:13.876842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743633    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743636    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743640    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743643    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743647    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743650    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743653    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743656    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743660    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743663    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743673    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743677    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743681    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743684    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743687    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743689    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743693    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743696    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743699    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743703    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:13.877686 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743705    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743708    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743712    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743715    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743719    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743725    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743728    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743731    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743734    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743736    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743739    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743742    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743745    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743748    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743752    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743755    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743758    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743761    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743763    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743766    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:13.878450 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743779    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743782    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743785    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743788    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743791    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743794    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743797    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743800    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743803    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743808    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743811    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743814    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743817    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743820    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743823    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743826    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743828    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743831    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743834    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743837    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:13.879530 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743839    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743842    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743845    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743848    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743851    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743853    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743856    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743862    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743880    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743884    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743888    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743891    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.743893    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744667    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744675    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744678    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744681    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744684    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744687    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:13.880255 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744690    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744693    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744696    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744699    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744703    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744706    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744709    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744712    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744715    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744718    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744720    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744723    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744726    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744729    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744732    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744735    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744738    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744743    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:13.880922 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744747    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744750    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744754    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744757    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744760    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744762    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744765    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744768    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744772    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744775    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744777    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744780    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744783    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744786    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744788    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744792    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744795    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744798    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744801    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744804    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:13.881579 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744807    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744810    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744812    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744815    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744818    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744822    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744825    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744828    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744831    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744833    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744836    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744839    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744843    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744847    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744850    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744853    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744856    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744859    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744884    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744891    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:13.882221 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744896    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744901    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744905    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744908    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744911    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744915    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744918    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744921    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744924    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744927    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744934    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744938    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744941    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744944    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744946    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744949    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744952    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744955    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744958    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744960    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:13.883003 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744964    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744966    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744969    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744972    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744975    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744977    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744980    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744982    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744985    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744988    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744991    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744994    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.744997    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745000    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745002    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745427    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745433    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745436    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745439    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745444    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:13.884016 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745448    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745451    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745456    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745460    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745463    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745466    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745469    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745472    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745475    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745478    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745480    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745483    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745486    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745489    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745492    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745494    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745497    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745500    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745502    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745507    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:13.884652 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745510    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745512    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745515    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745518    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745521    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745523    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745526    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745529    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745531    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745534    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745537    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745540    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745542    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745545    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745551    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745554    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745557    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745559    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745563    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745566    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:14.073581 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745569    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745571    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745574    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745577    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745580    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745582    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745585    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745587    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745592    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745595    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745598    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745603    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745606    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745610    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745613    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745616    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745619    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745622    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745625    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:14.095597 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745628    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745631    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745634    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745636    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745639    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745642    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745645    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745649    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745652    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745654    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745658    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745660    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745663    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745666    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745669    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745671    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745675    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745678    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745680    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745683    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:14.096392 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745686    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745689    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745692    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745695    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745699    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745702    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745704    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745707    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745710    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745713    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745715    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745718    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745721    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745724    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.745726    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745805    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745813    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745819    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745824    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745830    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745834    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 16:40:14.097063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745838    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745843    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745855    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745859    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745877    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745880    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745884    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745887    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745890    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745894    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745897    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745900    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745904    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745907    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745911    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745915    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745919    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745928    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745931    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745934    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745938    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745941    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745944    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745948    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 16:40:14.097687 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745951    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745954    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745958    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745961    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745964    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745967    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745973    2575 flags.go:64] FLAG: --enable-server="true"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745976    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745981    2575 flags.go:64] FLAG: --event-burst="100"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745984    2575 flags.go:64] FLAG: --event-qps="50"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745988    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745992    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745995    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.745999    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746002    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746005    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746010    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746013    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746016    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746019    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746022    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746026    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746029    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746035    2575 flags.go:64] FLAG: --feature-gates=""
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746039    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 16:40:14.098467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746042    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746045    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746049    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746052    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746056    2575 flags.go:64] FLAG: --help="false"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746059    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746062    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746065    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746068    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746072    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746076    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746079    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746082    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746087    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746091    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746094    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746097    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746100    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746104    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746107    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746111    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746114    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746117    2575 flags.go:64] FLAG: --lock-file=""
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746120    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 16:40:14.099474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746123    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746127    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746133    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746136    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746139    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746142    2575 flags.go:64] FLAG: --logging-format="text"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746146    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746150    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746153    2575 flags.go:64] FLAG: --manifest-url=""
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746156    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746161    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746164    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746169    2575 flags.go:64] FLAG: --max-pods="110"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746172    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746175    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746178    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746182    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746185    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746188    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746191    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746199    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746204    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746207    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 16:40:14.100802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746210    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746213    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746220    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746224    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746227    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746231    2575 flags.go:64] FLAG: --port="10250"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746234    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746237    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f3a8b93853919de"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746241    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746244    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746247    2575 flags.go:64] FLAG: --register-node="true"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746250    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746254    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746257    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746260    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746263    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746269    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746272    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746275    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746279    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746282    2575 flags.go:64] FLAG: --runonce="false"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746285    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746289    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746292    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746295    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 16:40:14.101820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746298    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746302    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746305    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746308    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746312    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746316    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746319    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746322    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746325    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746328    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746332    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746337    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746340    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746344    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746348    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746351    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746354    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746357    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746360    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746363    2575 flags.go:64] FLAG: --v="2"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746368    2575 flags.go:64] FLAG: --version="false"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746372    2575 flags.go:64] FLAG: --vmodule=""
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746375    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746380    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746507    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:14.103114 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746511    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746515    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746518    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746521    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746525    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746528    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746532    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746535    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746539    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746542    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746545    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746548    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746552    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746555    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746558    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746561    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746564    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746566    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746569    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746571    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:14.104410 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746574    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746577    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746580    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746583    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746586    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746588    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746591    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746594    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746596    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746599    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746603    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746606    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746609    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746612    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746615    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746617    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746620    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746623    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746626    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746629    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:14.105433 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746631    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746634    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746637    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746640    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746643    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746646    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746649    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746652    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746654    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746657    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746661    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746664    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746668    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746671    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746676    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746679    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746682    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746685    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:14.106409 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746688    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746691    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746694    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746697    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746701    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746704    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746707    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746710    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746713    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746717    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746719    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746722    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746725    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746728    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746730    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746733    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746736    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746739    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746743    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746745    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:14.107383 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746748    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746751    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746753    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746756    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746759    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746761    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746764    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746767    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746770    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746773    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746775    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746778    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746781    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746783    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746786    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746788    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746793    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746795    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746798    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:14.108363 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.746800    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.746806    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.758863    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.758896    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.759871    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.759880    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759953    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759961    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759965    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759968    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759971    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759977    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759980    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759983    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:14.109377 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759986    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759989    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759993    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759996    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.759998    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760001    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760004    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760007    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760010    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760013    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760016    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760018    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760021    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760024    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760027    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760030    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760034    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760038    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760041    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760044    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:14.110159 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760047    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760050    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760053    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760056    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760059    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760061    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760064    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760067    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760070    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760075    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760077    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760080    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760083    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760086    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760089    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760092    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760094    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760097    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760100    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760103    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:14.111161 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760106    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760109    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760111    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760114    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760117    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760120    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760123    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760128    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760133    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760137    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760140    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760143    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760146    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760149    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760153    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760156    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760159    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760162    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760165    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:14.112162 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760169    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760172    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760176    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760179    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760182    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760185    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760188    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760191    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760194    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760196    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760199    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760202    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760206    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760209    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760212    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760215    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760218    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760221    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760224    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760227    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:14.113165 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760230    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760236    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760240    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760243    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760246    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760249    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760252    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760255    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760257    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760260    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760263    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760266    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.760272    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760399    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 16:40:14.116518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760406    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760410    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760413    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760417    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760420    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760423    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760426    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760428    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760432    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760435    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760438    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760443    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760447    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760450    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760453    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760456    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760459    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760462    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760465    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 16:40:14.117515 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760468    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760472    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760475    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760478    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760481    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760483    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760486    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760489    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760492    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760494    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760499    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760502    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760506    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760510    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760513    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760516    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760519    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760522    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760525    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 16:40:14.126635 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760528    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760531    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760534    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760538    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760540    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760543    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760547    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760550    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760553    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760556    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760558    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760561    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760564    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760566    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760573    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760575    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760578    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760581    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760583    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760586    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 16:40:14.127625 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760589    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760592    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760594    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760597    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760600    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760603    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760607    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760610    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760613    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760617    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760620    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760623    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760626    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760629    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760632    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760635    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760638    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760640    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760643    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760647    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 16:40:14.223329 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760649    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760652    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760655    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760658    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760661    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760663    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760667    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760670    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760673    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760676    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760678    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760681    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760684    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760687    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760690    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760692    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760695    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760698    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760703    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 16:40:14.225032 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:13.760705    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.760711    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.760839    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.766261    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.767896    2575 server.go:1019] "Starting client certificate rotation"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.768015    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.768047    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.771582    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.773446    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.785549    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.788067    2575 log.go:25] "Validated CRI v1 image API"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.791067    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 16:40:14.226129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.795654    2575 fs.go:135] Filesystem UUIDs: map[7509babf-0d8d-4ef5-86d1-142819443c1f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d87d3a4c-67ab-4935-b06f-a637b001d338:/dev/nvme0n1p3]
Jul 15 16:40:14.227146 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.795680    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.800747    2575 manager.go:216] Machine: {Timestamp:2026-07-15 16:40:13.800184628 +0000 UTC m=+0.370059918 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098352 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f87b372d171788b7f2f8b121017a0 SystemUUID:ec2f87b3-72d1-7178-8b7f-2f8b121017a0 BootID:aefebc7d-0d4a-4891-80c8-de264b2e7ec4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:18:23:d5:2e:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:18:23:d5:2e:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:7b:ab:c3:bb:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.800904    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.801013    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.803492    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.803523    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.804475    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.804487    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 16:40:14.227386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.804496    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.805326    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.807023    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.810313    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.810424    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811162    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811208    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811226    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811250    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811263    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811279    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811739    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.811760    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.814734    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816603    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816633    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816802    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816815    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816822    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816828    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816837    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.816844    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.817266    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.817275    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.817283    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.817290    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.817300    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.817309    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.818368    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.818377    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.822620    2575 server.go:1268] "Started kubelet"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.823097    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.823148    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.823834    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.824765    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.826059    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.827537    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.828915    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.828935    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 16:40:14.228134 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.829005    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.829548    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.829561    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.829706    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830199    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830204    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830219    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830285    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830295    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830664    2575 factory.go:153] Registering CRI-O factory
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830701    2575 factory.go:223] Registration of the crio container factory successfully
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830754    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830765    2575 factory.go:55] Registering systemd factory
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830773    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830794    2575 factory.go:103] Registering Raw factory
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.830823    2575 manager.go:1196] Started watching for new ooms in manager
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.831502    2575 manager.go:349] Starting recovery of all containers
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.840180    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.840334    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.840463    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-165.ec2.internal.18c28411abbaa383  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-165.ec2.internal,UID:ip-10-0-135-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-165.ec2.internal,},FirstTimestamp:2026-07-15 16:40:13.822583683 +0000 UTC m=+0.392458979,LastTimestamp:2026-07-15 16:40:13.822583683 +0000 UTC m=+0.392458979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-165.ec2.internal,}"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.843401    2575 manager.go:354] Recovery completed
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.849276    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.853480    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.855434    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.855474    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.855486    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.856340    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.856356    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.856376    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 16:40:14.230221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.857076    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.860561    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-165.ec2.internal.18c28411adb032be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-165.ec2.internal,UID:ip-10-0-135-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-165.ec2.internal,},FirstTimestamp:2026-07-15 16:40:13.855453886 +0000 UTC m=+0.425329179,LastTimestamp:2026-07-15 16:40:13.855453886 +0000 UTC m=+0.425329179,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-165.ec2.internal,}"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.861324    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.861353    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.861364    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.861826    2575 policy_none.go:49] "None policy: Start"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.861846    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.861859    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.862813    2575 policy_none.go:47] "Start"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.867953    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-llkst"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.870972    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-165.ec2.internal.18c28411adb09809  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-165.ec2.internal,UID:ip-10-0-135-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-165.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-165.ec2.internal,},FirstTimestamp:2026-07-15 16:40:13.855479817 +0000 UTC m=+0.425355108,LastTimestamp:2026-07-15 16:40:13.855479817 +0000 UTC m=+0.425355108,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-165.ec2.internal,}"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.875771    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-llkst"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.904629    2575 manager.go:337] "Starting Device Plugin manager"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.904693    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.904708    2575 server.go:87] "Starting device plugin registration server"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.905085    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.905101    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.905195    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.905287    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:13.905297    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.905970    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:13.906012    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.006066    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.007186    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.007216    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.007228    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.231777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.007256    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.014610    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.014637    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-165.ec2.internal\": node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.015975    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.017365    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.017404    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.017433    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.017476    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.019994    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.026267    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.118902    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"]
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.119004    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.120348    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.120374    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.120396    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.121943    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.122129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.122156    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.122984    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.123004    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.123013    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.123252    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.123265    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.123273    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.124754    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.124778    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.125728    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.125747    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.125758    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.130742    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.133837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/866426ac2f7ae52b0b5d62a269c4afca-config\") pod \"kube-apiserver-proxy-ip-10-0-135-165.ec2.internal\" (UID: \"866426ac2f7ae52b0b5d62a269c4afca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.233048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.133859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7ae6d8d547fd83c4cffd3ba01c3ba31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal\" (UID: \"a7ae6d8d547fd83c4cffd3ba01c3ba31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.133879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7ae6d8d547fd83c4cffd3ba01c3ba31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal\" (UID: \"a7ae6d8d547fd83c4cffd3ba01c3ba31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.148614    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-165.ec2.internal\" not found" node="ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.177959    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-165.ec2.internal\" not found" node="ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.230866    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.234034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/866426ac2f7ae52b0b5d62a269c4afca-config\") pod \"kube-apiserver-proxy-ip-10-0-135-165.ec2.internal\" (UID: \"866426ac2f7ae52b0b5d62a269c4afca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.234061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7ae6d8d547fd83c4cffd3ba01c3ba31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal\" (UID: \"a7ae6d8d547fd83c4cffd3ba01c3ba31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.234095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7ae6d8d547fd83c4cffd3ba01c3ba31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal\" (UID: \"a7ae6d8d547fd83c4cffd3ba01c3ba31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.234144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/866426ac2f7ae52b0b5d62a269c4afca-config\") pod \"kube-apiserver-proxy-ip-10-0-135-165.ec2.internal\" (UID: \"866426ac2f7ae52b0b5d62a269c4afca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.234148    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7ae6d8d547fd83c4cffd3ba01c3ba31-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal\" (UID: \"a7ae6d8d547fd83c4cffd3ba01c3ba31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.234547 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.234144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7ae6d8d547fd83c4cffd3ba01c3ba31-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal\" (UID: \"a7ae6d8d547fd83c4cffd3ba01c3ba31\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.400020 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.331012    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.560907 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.431882    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.560907 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.451737    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.560907 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.482198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:14.560907 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.531943    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.726785 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.632720    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.733192    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.767028    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.767188    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.799174    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.834009    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.879128    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 16:35:14 +0000 UTC" deadline="2028-01-28 23:07:16.392681093 +0000 UTC"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.879173    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13494h27m1.513511609s"
Jul 15 16:40:14.922070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:14.917960    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:15.116582 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:14.934474    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:15.116582 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.034528    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:15.116582 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.048984    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 16:40:15.116582 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.055904    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 16:40:15.116582 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.055945    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 16:40:15.116582 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.055962    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeHasSufficientPID"
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:15.133332    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866426ac2f7ae52b0b5d62a269c4afca.slice/crio-f68d4e733dc41e1608d48e49ec285cdc0bdc9c6bf1ce94889d7bb28b86f8846f WatchSource:0}: Error finding container f68d4e733dc41e1608d48e49ec285cdc0bdc9c6bf1ce94889d7bb28b86f8846f: Status 404 returned error can't find the container with id f68d4e733dc41e1608d48e49ec285cdc0bdc9c6bf1ce94889d7bb28b86f8846f
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.135537    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-165.ec2.internal\" not found"
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.138658    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.168852    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:15.183403    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ae6d8d547fd83c4cffd3ba01c3ba31.slice/crio-86453276a228a31ae42c2490b6b8797ea1be630ec7cee4fa51f9ccacf4b1628c WatchSource:0}: Error finding container 86453276a228a31ae42c2490b6b8797ea1be630ec7cee4fa51f9ccacf4b1628c: Status 404 returned error can't find the container with id 86453276a228a31ae42c2490b6b8797ea1be630ec7cee4fa51f9ccacf4b1628c
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.231849    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.243334    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.245111    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal"
Jul 15 16:40:15.343600 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.253968    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.815367    2575 apiserver.go:52] "Watching apiserver"
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.824774    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.825211    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-dg7fn","kube-system/konnectivity-agent-29mdj","kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal","openshift-multus/multus-additional-cni-plugins-bkd6k","openshift-multus/multus-hlktn","openshift-network-diagnostics/network-check-target-v8ln4","openshift-network-operator/iptables-alerter-b9vz4","openshift-ovn-kubernetes/ovnkube-node-vpvmq","kube-system/global-pull-secret-syncer-g4xjf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t","openshift-cluster-node-tuning-operator/tuned-47wqd","openshift-dns/node-resolver-smvl6","openshift-image-registry/node-ca-jlk9h"]
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.827911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.827985    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.830728    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 16:40:15.831594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.830979    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:15.834939 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.833246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:15.834939 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.834368    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9mstl\""
Jul 15 16:40:15.834939 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.834663    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.834939 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.834892    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.835857 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.835635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:15.835857 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.835696    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.836538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.836362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.836538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.836319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gqtq7\""
Jul 15 16:40:15.836538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.836437    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.838087    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.838988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.839096    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb2js\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.839144    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.839442    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.840384    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.840467    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.840812    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9722\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.840877    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.840938    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.840812    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.841021    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.842635    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.842750    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7hswm\""
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.843755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ecb014ab-7df6-43ff-b6df-5164e09bde95-hosts-file\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecb014ab-7df6-43ff-b6df-5164e09bde95-tmp-dir\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hsk8\" (UniqueName: \"kubernetes.io/projected/ecb014ab-7df6-43ff-b6df-5164e09bde95-kube-api-access-2hsk8\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b36c47c-a728-453c-94f3-c2e732977410-serviceca\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b995a7c-f16e-4733-ac64-d05c9c089497-dbus\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:15.956163 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b36c47c-a728-453c-94f3-c2e732977410-host\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrgb7\" (UniqueName: \"kubernetes.io/projected/9b36c47c-a728-453c-94f3-c2e732977410-kube-api-access-mrgb7\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.845825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b995a7c-f16e-4733-ac64-d05c9c089497-kubelet-config\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.846196    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.846271    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.846548    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.846568    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.846780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m6pvw\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.846794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.846872    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.847394    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.847401    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.847912    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.848879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.852522    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k7478\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.852864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.852984    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.853145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.853374    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.855309    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.857629    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.857811    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.857856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tvjfp\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.857811    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.858167    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:15.958191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.865362    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.865424    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.865426    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xlmj\""
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.870173    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rf4t4"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.875199    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.878583    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rf4t4"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.931326    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.946713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.946759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysconfig\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.946789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-log-socket\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.946857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9xd\" (UniqueName: \"kubernetes.io/projected/1fff4afe-dbb3-4255-9254-ca1e96775047-kube-api-access-mg9xd\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.946893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-kubelet\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.946900    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.946949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-multus-certs\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:15.947071    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:16.447027477 +0000 UTC m=+3.016902769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-os-release\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.961258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-tmp\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-system-cni-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947237    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-conf-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-etc-kubernetes\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-cni-netd\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d55ef920-0100-4205-abc1-0b3041279bc1-konnectivity-ca\") pod \"konnectivity-agent-29mdj\" (UID: \"d55ef920-0100-4205-abc1-0b3041279bc1\") " pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-run\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-system-cni-dir\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-socket-dir-parent\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b36c47c-a728-453c-94f3-c2e732977410-host\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-kubernetes\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:15.962268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-lib-modules\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b36c47c-a728-453c-94f3-c2e732977410-host\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-var-lib-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947574    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-env-overrides\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b888e67a-0695-497b-827f-59fb831bdad3-ovn-node-metrics-cert\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947630    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-etc-selinux\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecb014ab-7df6-43ff-b6df-5164e09bde95-tmp-dir\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-kubelet\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-run-netns\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-cni-bin\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fdtk\" (UniqueName: \"kubernetes.io/projected/74f99036-13b3-4aab-ab8b-c3d41f55250d-kube-api-access-5fdtk\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-modprobe-d\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-systemd\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.078130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-tuned\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-cnibin\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.947997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-cni-multus\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b995a7c-f16e-4733-ac64-d05c9c089497-kubelet-config\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b36c47c-a728-453c-94f3-c2e732977410-serviceca\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecb014ab-7df6-43ff-b6df-5164e09bde95-tmp-dir\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b995a7c-f16e-4733-ac64-d05c9c089497-kubelet-config\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-socket-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-host\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpbht\" (UniqueName: \"kubernetes.io/projected/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-kube-api-access-lpbht\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:16.079151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtb2h\" (UniqueName: \"kubernetes.io/projected/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-kube-api-access-vtb2h\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrgb7\" (UniqueName: \"kubernetes.io/projected/9b36c47c-a728-453c-94f3-c2e732977410-kube-api-access-mrgb7\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ecb014ab-7df6-43ff-b6df-5164e09bde95-hosts-file\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hsk8\" (UniqueName: \"kubernetes.io/projected/ecb014ab-7df6-43ff-b6df-5164e09bde95-kube-api-access-2hsk8\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-etc-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948470    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ecb014ab-7df6-43ff-b6df-5164e09bde95-hosts-file\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-ovnkube-script-lib\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-systemd\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-node-log\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-k8s-cni-cncf-io\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948632    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b36c47c-a728-453c-94f3-c2e732977410-serviceca\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.948640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-hostroot\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d55ef920-0100-4205-abc1-0b3041279bc1-agent-certs\") pod \"konnectivity-agent-29mdj\" (UID: \"d55ef920-0100-4205-abc1-0b3041279bc1\") " pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:16.080188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysctl-conf\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-systemd-units\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-sys-fs\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-iptables-alerter-script\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqrb\" (UniqueName: \"kubernetes.io/projected/b888e67a-0695-497b-827f-59fb831bdad3-kube-api-access-szqrb\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b995a7c-f16e-4733-ac64-d05c9c089497-dbus\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-os-release\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-slash\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-device-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949385    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-var-lib-kubelet\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-ovnkube-config\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-host-slash\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.949495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b995a7c-f16e-4733-ac64-d05c9c089497-dbus\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.958126    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 16:40:16.084728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2zl\" (UniqueName: \"kubernetes.io/projected/af4944f4-8a9f-469d-968f-efb49eeeac8b-kube-api-access-pq2zl\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-registration-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961279    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-cni-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-cnibin\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f99036-13b3-4aab-ab8b-c3d41f55250d-cni-binary-copy\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961353    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-netns\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-daemon-config\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58tfb\" (UniqueName: \"kubernetes.io/projected/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-kube-api-access-58tfb\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysctl-d\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-sys\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-ovn\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.961550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-cni-bin\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.962248    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrgb7\" (UniqueName: \"kubernetes.io/projected/9b36c47c-a728-453c-94f3-c2e732977410-kube-api-access-mrgb7\") pod \"node-ca-jlk9h\" (UID: \"9b36c47c-a728-453c-94f3-c2e732977410\") " pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:15.962315    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hsk8\" (UniqueName: \"kubernetes.io/projected/ecb014ab-7df6-43ff-b6df-5164e09bde95-kube-api-access-2hsk8\") pod \"node-resolver-smvl6\" (UID: \"ecb014ab-7df6-43ff-b6df-5164e09bde95\") " pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.085666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.027189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal" event={"ID":"a7ae6d8d547fd83c4cffd3ba01c3ba31","Type":"ContainerStarted","Data":"86453276a228a31ae42c2490b6b8797ea1be630ec7cee4fa51f9ccacf4b1628c"}
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.030332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal" event={"ID":"866426ac2f7ae52b0b5d62a269c4afca","Type":"ContainerStarted","Data":"f68d4e733dc41e1608d48e49ec285cdc0bdc9c6bf1ce94889d7bb28b86f8846f"}
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-modprobe-d\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-systemd\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-tuned\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-cnibin\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062233    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-systemd\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-cni-multus\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062293    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-modprobe-d\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062305    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-cni-multus\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062361    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.086604 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062369    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-run-ovn-kubernetes\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-socket-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-cnibin\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.062458    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.062516    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:16.562496148 +0000 UTC m=+3.132371439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062527    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-socket-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-host\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpbht\" (UniqueName: \"kubernetes.io/projected/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-kube-api-access-lpbht\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtb2h\" (UniqueName: \"kubernetes.io/projected/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-kube-api-access-vtb2h\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-host\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-etc-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.062742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-etc-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.087396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-ovnkube-script-lib\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-systemd\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063098    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-node-log\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-k8s-cni-cncf-io\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063136    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-hostroot\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-node-log\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063180    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d55ef920-0100-4205-abc1-0b3041279bc1-agent-certs\") pod \"konnectivity-agent-29mdj\" (UID: \"d55ef920-0100-4205-abc1-0b3041279bc1\") " pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-systemd\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysctl-conf\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063232    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-systemd-units\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-sys-fs\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-hostroot\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-systemd-units\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-iptables-alerter-script\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063371    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-sys-fs\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqrb\" (UniqueName: \"kubernetes.io/projected/b888e67a-0695-497b-827f-59fb831bdad3-kube-api-access-szqrb\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-os-release\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-slash\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063464    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysctl-conf\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-device-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-var-lib-kubelet\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063530    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-ovnkube-config\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-host-slash\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-host-slash\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-k8s-cni-cncf-io\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2zl\" (UniqueName: \"kubernetes.io/projected/af4944f4-8a9f-469d-968f-efb49eeeac8b-kube-api-access-pq2zl\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-registration-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.088965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-os-release\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-cni-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-ovnkube-script-lib\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-cnibin\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063740    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-slash\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f99036-13b3-4aab-ab8b-c3d41f55250d-cni-binary-copy\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-netns\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063825    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-device-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-daemon-config\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-iptables-alerter-script\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58tfb\" (UniqueName: \"kubernetes.io/projected/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-kube-api-access-58tfb\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-netns\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.063888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-cnibin\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysctl-d\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-var-lib-kubelet\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.089603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064036    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-sys\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-ovn\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064120    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-registration-dir\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-cni-bin\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064170    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-sys\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysconfig\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-log-socket\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9xd\" (UniqueName: \"kubernetes.io/projected/1fff4afe-dbb3-4255-9254-ca1e96775047-kube-api-access-mg9xd\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064325    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-kubelet\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-multus-certs\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-os-release\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064421    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f99036-13b3-4aab-ab8b-c3d41f55250d-cni-binary-copy\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-ovn\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-tmp\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.090349 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064472    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-cni-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-ovnkube-config\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysconfig\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064711    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-sysctl-d\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-cni-bin\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-run-multus-certs\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-system-cni-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-conf-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-system-cni-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-etc-kubernetes\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-cni-netd\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-etc-kubernetes\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-os-release\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d55ef920-0100-4205-abc1-0b3041279bc1-konnectivity-ca\") pod \"konnectivity-agent-29mdj\" (UID: \"d55ef920-0100-4205-abc1-0b3041279bc1\") " pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:16.091115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-host-var-lib-kubelet\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-run\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-cni-netd\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.064992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-run-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065014    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-conf-dir\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-system-cni-dir\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-log-socket\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-run\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-system-cni-dir\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065117    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-daemon-config\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-socket-dir-parent\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.091689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-kubernetes\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af4944f4-8a9f-469d-968f-efb49eeeac8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-lib-modules\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74f99036-13b3-4aab-ab8b-c3d41f55250d-multus-socket-dir-parent\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-kubernetes\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-var-lib-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-env-overrides\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b888e67a-0695-497b-827f-59fb831bdad3-ovn-node-metrics-cert\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065615    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-lib-modules\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-etc-selinux\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af4944f4-8a9f-469d-968f-efb49eeeac8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-kubelet\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-run-netns\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.119333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065797    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1fff4afe-dbb3-4255-9254-ca1e96775047-etc-selinux\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-kubelet\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-cni-bin\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065918    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-var-lib-openvswitch\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065944    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-run-netns\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b888e67a-0695-497b-827f-59fb831bdad3-host-cni-bin\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.065968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b888e67a-0695-497b-827f-59fb831bdad3-env-overrides\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.066063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fdtk\" (UniqueName: \"kubernetes.io/projected/74f99036-13b3-4aab-ab8b-c3d41f55250d-kube-api-access-5fdtk\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.066104    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d55ef920-0100-4205-abc1-0b3041279bc1-konnectivity-ca\") pod \"konnectivity-agent-29mdj\" (UID: \"d55ef920-0100-4205-abc1-0b3041279bc1\") " pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.067161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d55ef920-0100-4205-abc1-0b3041279bc1-agent-certs\") pod \"konnectivity-agent-29mdj\" (UID: \"d55ef920-0100-4205-abc1-0b3041279bc1\") " pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.068834    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b888e67a-0695-497b-827f-59fb831bdad3-ovn-node-metrics-cert\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.069018    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-etc-tuned\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.076389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqrb\" (UniqueName: \"kubernetes.io/projected/b888e67a-0695-497b-827f-59fb831bdad3-kube-api-access-szqrb\") pod \"ovnkube-node-vpvmq\" (UID: \"b888e67a-0695-497b-827f-59fb831bdad3\") " pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.076935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtb2h\" (UniqueName: \"kubernetes.io/projected/7d9d3e8e-c6d4-499f-9c73-458ce73b9c24-kube-api-access-vtb2h\") pod \"iptables-alerter-b9vz4\" (UID: \"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24\") " pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.078931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpbht\" (UniqueName: \"kubernetes.io/projected/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-kube-api-access-lpbht\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:16.120297 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.079467    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.079488    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.079503    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.079570    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:40:16.579550199 +0000 UTC m=+3.149425482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.080070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-tmp\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.081100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2zl\" (UniqueName: \"kubernetes.io/projected/af4944f4-8a9f-469d-968f-efb49eeeac8b-kube-api-access-pq2zl\") pod \"multus-additional-cni-plugins-bkd6k\" (UID: \"af4944f4-8a9f-469d-968f-efb49eeeac8b\") " pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.082946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9xd\" (UniqueName: \"kubernetes.io/projected/1fff4afe-dbb3-4255-9254-ca1e96775047-kube-api-access-mg9xd\") pod \"aws-ebs-csi-driver-node-m679t\" (UID: \"1fff4afe-dbb3-4255-9254-ca1e96775047\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.083367    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58tfb\" (UniqueName: \"kubernetes.io/projected/cb618631-4511-47e6-bd2c-9ae79ee9ac8e-kube-api-access-58tfb\") pod \"tuned-47wqd\" (UID: \"cb618631-4511-47e6-bd2c-9ae79ee9ac8e\") " pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.121051 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.084174    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fdtk\" (UniqueName: \"kubernetes.io/projected/74f99036-13b3-4aab-ab8b-c3d41f55250d-kube-api-access-5fdtk\") pod \"multus-hlktn\" (UID: \"74f99036-13b3-4aab-ab8b-c3d41f55250d\") " pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.145987 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.145949    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smvl6"
Jul 15 16:40:16.154782 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.154658    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jlk9h"
Jul 15 16:40:16.166319 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.165985    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb014ab_7df6_43ff_b6df_5164e09bde95.slice/crio-2a3729dfec00b7573e80d5bc1a4011e7adf7fecfc69d6c04cc46c2b64f94a977 WatchSource:0}: Error finding container 2a3729dfec00b7573e80d5bc1a4011e7adf7fecfc69d6c04cc46c2b64f94a977: Status 404 returned error can't find the container with id 2a3729dfec00b7573e80d5bc1a4011e7adf7fecfc69d6c04cc46c2b64f94a977
Jul 15 16:40:16.169406 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.169135    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b36c47c_a728_453c_94f3_c2e732977410.slice/crio-9476ab57d778244a79a1fc52d29297401ba56b37a6cd727235f043488abe1be7 WatchSource:0}: Error finding container 9476ab57d778244a79a1fc52d29297401ba56b37a6cd727235f043488abe1be7: Status 404 returned error can't find the container with id 9476ab57d778244a79a1fc52d29297401ba56b37a6cd727235f043488abe1be7
Jul 15 16:40:16.172291 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.172058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b9vz4"
Jul 15 16:40:16.178626 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.178603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t"
Jul 15 16:40:16.186139 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.185706    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bkd6k"
Jul 15 16:40:16.194420 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.194394    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hlktn"
Jul 15 16:40:16.198419 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.198389    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fff4afe_dbb3_4255_9254_ca1e96775047.slice/crio-78cabf7e1bd337d24e7a5a46bc37e773fbb18ad99e209ae0cd678220129c70da WatchSource:0}: Error finding container 78cabf7e1bd337d24e7a5a46bc37e773fbb18ad99e209ae0cd678220129c70da: Status 404 returned error can't find the container with id 78cabf7e1bd337d24e7a5a46bc37e773fbb18ad99e209ae0cd678220129c70da
Jul 15 16:40:16.201760 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.201736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:16.203500 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.203471    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4944f4_8a9f_469d_968f_efb49eeeac8b.slice/crio-0e919e54d5c0d530b52d581f56ea2061eb0c92b2c5cec9f8567b611aa6cb8dc3 WatchSource:0}: Error finding container 0e919e54d5c0d530b52d581f56ea2061eb0c92b2c5cec9f8567b611aa6cb8dc3: Status 404 returned error can't find the container with id 0e919e54d5c0d530b52d581f56ea2061eb0c92b2c5cec9f8567b611aa6cb8dc3
Jul 15 16:40:16.214265 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.214233    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f99036_13b3_4aab_ab8b_c3d41f55250d.slice/crio-ee5b2ea80b71a9f7aadc693a49572634811bc8bcea125eaf2fe4ff7af170ee97 WatchSource:0}: Error finding container ee5b2ea80b71a9f7aadc693a49572634811bc8bcea125eaf2fe4ff7af170ee97: Status 404 returned error can't find the container with id ee5b2ea80b71a9f7aadc693a49572634811bc8bcea125eaf2fe4ff7af170ee97
Jul 15 16:40:16.226638 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.226613    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:16.228160 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.228133    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-47wqd"
Jul 15 16:40:16.242746 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.242710    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55ef920_0100_4205_abc1_0b3041279bc1.slice/crio-a3ec52ecf8f6d2df30443afdf3c6a175a68176e6c22f37aff3d42db323757aea WatchSource:0}: Error finding container a3ec52ecf8f6d2df30443afdf3c6a175a68176e6c22f37aff3d42db323757aea: Status 404 returned error can't find the container with id a3ec52ecf8f6d2df30443afdf3c6a175a68176e6c22f37aff3d42db323757aea
Jul 15 16:40:16.248765 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:16.248733    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb618631_4511_47e6_bd2c_9ae79ee9ac8e.slice/crio-7d143620f6f996da62b57e3cd7ae1dd64bd93c7904e77395ca12263411d7093f WatchSource:0}: Error finding container 7d143620f6f996da62b57e3cd7ae1dd64bd93c7904e77395ca12263411d7093f: Status 404 returned error can't find the container with id 7d143620f6f996da62b57e3cd7ae1dd64bd93c7904e77395ca12263411d7093f
Jul 15 16:40:16.469310 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.469202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:16.469491 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.469379    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:16.469491 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.469460    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:17.469441315 +0000 UTC m=+4.039316590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:16.570458 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.570424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:16.570662 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.570610    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:16.570728 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.570693    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:17.570669273 +0000 UTC m=+4.140544548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:16.671790 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.671757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:16.672072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.671966    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:16.672072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.671986    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:16.672072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.671997    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:16.672072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:16.672066    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:40:17.672044644 +0000 UTC m=+4.241919959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:16.882808 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.882648    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:35:16 +0000 UTC" deadline="2028-02-24 14:07:57.158645222 +0000 UTC"
Jul 15 16:40:16.882808 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:16.882734    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14133h27m40.27591521s"
Jul 15 16:40:17.018173 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.018127    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:17.018797 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.018183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:17.018797 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.018269    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:17.018797 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.018415    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:17.033968 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.033915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47wqd" event={"ID":"cb618631-4511-47e6-bd2c-9ae79ee9ac8e","Type":"ContainerStarted","Data":"7d143620f6f996da62b57e3cd7ae1dd64bd93c7904e77395ca12263411d7093f"}
Jul 15 16:40:17.035340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.035292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hlktn" event={"ID":"74f99036-13b3-4aab-ab8b-c3d41f55250d","Type":"ContainerStarted","Data":"ee5b2ea80b71a9f7aadc693a49572634811bc8bcea125eaf2fe4ff7af170ee97"}
Jul 15 16:40:17.036607 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.036576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerStarted","Data":"0e919e54d5c0d530b52d581f56ea2061eb0c92b2c5cec9f8567b611aa6cb8dc3"}
Jul 15 16:40:17.037852 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.037822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t" event={"ID":"1fff4afe-dbb3-4255-9254-ca1e96775047","Type":"ContainerStarted","Data":"78cabf7e1bd337d24e7a5a46bc37e773fbb18ad99e209ae0cd678220129c70da"}
Jul 15 16:40:17.039109 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.039086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smvl6" event={"ID":"ecb014ab-7df6-43ff-b6df-5164e09bde95","Type":"ContainerStarted","Data":"2a3729dfec00b7573e80d5bc1a4011e7adf7fecfc69d6c04cc46c2b64f94a977"}
Jul 15 16:40:17.040481 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.040454    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-29mdj" event={"ID":"d55ef920-0100-4205-abc1-0b3041279bc1","Type":"ContainerStarted","Data":"a3ec52ecf8f6d2df30443afdf3c6a175a68176e6c22f37aff3d42db323757aea"}
Jul 15 16:40:17.041748 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.041724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"2aadd8db4761d66978e1f0a6dc176e4b700903ea4bb08b3f7b62924e235bedcf"}
Jul 15 16:40:17.043065 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.042959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b9vz4" event={"ID":"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24","Type":"ContainerStarted","Data":"5ede09d2e947701687142c061556351c192dfcdb08c48b1aa50380b7f9a1a399"}
Jul 15 16:40:17.044063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.044044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jlk9h" event={"ID":"9b36c47c-a728-453c-94f3-c2e732977410","Type":"ContainerStarted","Data":"9476ab57d778244a79a1fc52d29297401ba56b37a6cd727235f043488abe1be7"}
Jul 15 16:40:17.478136 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.478090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:17.478445 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.478264    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:17.478445 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.478392    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:19.478361324 +0000 UTC m=+6.048243467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:17.579181 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.579126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:17.579372 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.579358    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:17.579458 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.579444    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:19.579418299 +0000 UTC m=+6.149293575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:17.681037 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.680248    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:17.681037 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.680494    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:17.681037 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.680521    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:17.681037 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.680535    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:17.681037 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:17.680603    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:40:19.680584821 +0000 UTC m=+6.250460100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:17.885853 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.883052    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 16:35:16 +0000 UTC" deadline="2028-02-27 21:19:23.007649302 +0000 UTC"
Jul 15 16:40:17.885853 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:17.883347    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14212h39m5.124311706s"
Jul 15 16:40:18.021396 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:18.020702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:18.021396 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:18.020878    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:18.069615 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:18.068672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal" event={"ID":"866426ac2f7ae52b0b5d62a269c4afca","Type":"ContainerStarted","Data":"83d75eadda4aab0ece1f838b88d761c48239ebd453f37901b29e20c5a7f251ef"}
Jul 15 16:40:19.018621 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.018586    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:19.018815 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.018738    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:19.019356 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.019180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:19.019356 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.019290    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:19.075920 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.075267    2575 generic.go:356] "Generic (PLEG): container finished" podID="a7ae6d8d547fd83c4cffd3ba01c3ba31" containerID="861c6c0c93afeef2541f994c97c5a86112f2e448e4edf9c8847bc158e7c68faa" exitCode=0
Jul 15 16:40:19.075920 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.075424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal" event={"ID":"a7ae6d8d547fd83c4cffd3ba01c3ba31","Type":"ContainerDied","Data":"861c6c0c93afeef2541f994c97c5a86112f2e448e4edf9c8847bc158e7c68faa"}
Jul 15 16:40:19.098885 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.096900    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-165.ec2.internal" podStartSLOduration=4.096877919 podStartE2EDuration="4.096877919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:18.089031986 +0000 UTC m=+4.658907296" watchObservedRunningTime="2026-07-15 16:40:19.096877919 +0000 UTC m=+5.666753220"
Jul 15 16:40:19.502157 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.502058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:19.502385 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.502355    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:19.502449 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.502429    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:23.502409624 +0000 UTC m=+10.072284906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:19.603020 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.602980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:19.603222 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.603138    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:19.603222 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.603208    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:23.603188522 +0000 UTC m=+10.173063797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:19.704087 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:19.704027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:19.704368 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.704338    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:19.704368 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.704367    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:19.704524 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.704382    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:19.704524 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:19.704446    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:40:23.704427408 +0000 UTC m=+10.274302700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:20.020713 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:20.020680    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:20.020939 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:20.020826    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:21.018373 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:21.018326    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:21.018373 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:21.018374    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:21.018937 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:21.018535    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:21.018937 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:21.018640    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:22.018105 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:22.017872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:22.018105 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:22.018016    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:23.018218 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:23.018183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:23.018678 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.018414    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:23.018881 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:23.018862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:23.019006 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.018982    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:23.539927 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:23.539876    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:23.540120 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.540045    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:23.540120 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.540110    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:31.540091486 +0000 UTC m=+18.109966766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:23.640837 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:23.640777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:23.641030 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.640955    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:23.641105 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.641038    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:31.641019949 +0000 UTC m=+18.210895224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:23.742233 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:23.742101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:23.742410 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.742299    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:23.742410 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.742323    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:23.742410 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.742339    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:23.742410 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:23.742407    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:40:31.742386342 +0000 UTC m=+18.312261617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:24.020166 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:24.019947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:24.020608 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:24.020236    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:25.018331 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:25.018296    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:25.018508 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:25.018312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:25.018508 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:25.018460    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:25.018508 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:25.018485    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:26.018127 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:26.018095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:26.018557 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:26.018247    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:27.018490 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:27.018455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:27.018964 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:27.018455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:27.018964 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:27.018591    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:27.018964 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:27.018654    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:28.018692 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:28.018649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:28.019548 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:28.018811    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:29.018056 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:29.018016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:29.018241 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:29.018159    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:29.018241 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:29.018205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:29.018368 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:29.018313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:30.018135 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:30.018096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:30.018589 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:30.018236    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:31.018219 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:31.018180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:31.018219 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:31.018221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:31.018780 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.018336    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:31.018780 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.018483    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:31.611443 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:31.611400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:31.611715 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.611575    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:31.611715 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.611658    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:47.611636252 +0000 UTC m=+34.181511537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:31.712263 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:31.712213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:31.712467 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.712343    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:31.712467 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.712417    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:40:47.71239845 +0000 UTC m=+34.282273747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:31.813453 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:31.813410    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:31.813630 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.813566    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:31.813630 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.813589    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:31.813630 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.813602    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:31.813828 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:31.813658    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:40:47.81364118 +0000 UTC m=+34.383516462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:32.021151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:32.021078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:32.021509 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:32.021183    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:32.021509 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:32.021267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:32.021509 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:32.021353    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:33.017972 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:33.017931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:33.018228 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:33.018084    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:34.019443 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:34.019399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:34.019912 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:34.019520    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:34.019912 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:34.019573    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:34.019912 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:34.019654    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:35.018402 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:35.018366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:35.018606 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:35.018498    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:36.017688 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:36.017660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:36.018043 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:36.017815    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:36.018043 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:36.017829    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:36.018043 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:36.017940    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:36.117151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:36.117110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal" event={"ID":"a7ae6d8d547fd83c4cffd3ba01c3ba31","Type":"ContainerStarted","Data":"d6169a028afb77a97a77ab876c0d19fb4a9995eccf2d567858734790a73c21d6"}
Jul 15 16:40:36.136058 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:36.135856    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-165.ec2.internal" podStartSLOduration=21.135839141 podStartE2EDuration="21.135839141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:36.135337454 +0000 UTC m=+22.705212749" watchObservedRunningTime="2026-07-15 16:40:36.135839141 +0000 UTC m=+22.705714436"
Jul 15 16:40:37.018407 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.018200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:37.019130 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:37.018493    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:37.120946 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.120913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hlktn" event={"ID":"74f99036-13b3-4aab-ab8b-c3d41f55250d","Type":"ContainerStarted","Data":"fb0f498641423ebcdb21a237d8218f3189395c90b64b65eb11f6399f82edab32"}
Jul 15 16:40:37.122582 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.122551    2575 generic.go:356] "Generic (PLEG): container finished" podID="af4944f4-8a9f-469d-968f-efb49eeeac8b" containerID="4564fea5eb67f511fa448d675fb7e6f8327fb59ed762ef61d0c0982e5300d9e4" exitCode=0
Jul 15 16:40:37.122724 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.122630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerDied","Data":"4564fea5eb67f511fa448d675fb7e6f8327fb59ed762ef61d0c0982e5300d9e4"}
Jul 15 16:40:37.124128 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.124107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t" event={"ID":"1fff4afe-dbb3-4255-9254-ca1e96775047","Type":"ContainerStarted","Data":"f5dfc0b3453b0d660124ae2f2adf11a13203c747c2356c679c73bcb21b290b8c"}
Jul 15 16:40:37.125706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.125680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smvl6" event={"ID":"ecb014ab-7df6-43ff-b6df-5164e09bde95","Type":"ContainerStarted","Data":"7030b4f05dfc5be3fe66a949d3f4649406ed9776533a22e528d5040af00f2918"}
Jul 15 16:40:37.127137 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.127106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-29mdj" event={"ID":"d55ef920-0100-4205-abc1-0b3041279bc1","Type":"ContainerStarted","Data":"9cee34d1f9d9f76767d1ee6fc8ef26a1f4716960c0822269ffa787c280105dc5"}
Jul 15 16:40:37.130037 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130018    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:40:37.130405 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130381    2575 generic.go:356] "Generic (PLEG): container finished" podID="b888e67a-0695-497b-827f-59fb831bdad3" containerID="3ff60713a8add7219adcaac521538e695450d0c075c5fb972bc86c988baa9e8e" exitCode=1
Jul 15 16:40:37.130471 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"697ed76323b5b5ac3e9f4a74ae096466df4f93a4d5f89af5946268168715af9b"}
Jul 15 16:40:37.130532 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130516    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"73076ecaf7e75dc637d2660b612610bc477c741d9aab0f23ab5e4da33ae3c058"}
Jul 15 16:40:37.130598 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130578    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"1e591107354a567a63a1f8d6dd06b2ca2ad961bb81db2c6dcc037d061f6df31c"}
Jul 15 16:40:37.130643 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"b35b0af07f30ce2c9bfb2c0d53b19e3a68b7e9300da2541dcac1c45f6b753f00"}
Jul 15 16:40:37.130683 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerDied","Data":"3ff60713a8add7219adcaac521538e695450d0c075c5fb972bc86c988baa9e8e"}
Jul 15 16:40:37.130734 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.130717    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"e054b67613bf573e226fe3ab2500b105b93201d16dfe49d88a514c8017755c98"}
Jul 15 16:40:37.131798 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.131759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jlk9h" event={"ID":"9b36c47c-a728-453c-94f3-c2e732977410","Type":"ContainerStarted","Data":"28f19f2fdba478af72303e7ec501a6eb842647fc1389c940eae66b8f3de04950"}
Jul 15 16:40:37.133200 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.133179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-47wqd" event={"ID":"cb618631-4511-47e6-bd2c-9ae79ee9ac8e","Type":"ContainerStarted","Data":"a20edd2491c8d0e99e5b078b7dd364750c11efb1356532bceac8f8ad14a6135c"}
Jul 15 16:40:37.138323 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.138286    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hlktn" podStartSLOduration=2.881648787 podStartE2EDuration="23.138274325s" totalImagesPullingTime="20.256625538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:37.137975631 +0000 UTC m=+23.707850927" watchObservedRunningTime="2026-07-15 16:40:37.138274325 +0000 UTC m=+23.708149620"
Jul 15 16:40:37.153142 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.153097    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jlk9h" podStartSLOduration=3.355822771 podStartE2EDuration="23.15308222s" totalImagesPullingTime="19.797259449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:37.15251928 +0000 UTC m=+23.722394575" watchObservedRunningTime="2026-07-15 16:40:37.15308222 +0000 UTC m=+23.722957517"
Jul 15 16:40:37.172872 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.172814    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-47wqd" podStartSLOduration=3.442448906 podStartE2EDuration="23.172777243s" totalImagesPullingTime="19.730328337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:37.172270283 +0000 UTC m=+23.742145579" watchObservedRunningTime="2026-07-15 16:40:37.172777243 +0000 UTC m=+23.742652539"
Jul 15 16:40:37.219968 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.219910    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-29mdj" podStartSLOduration=3.571000522 podStartE2EDuration="23.219893311s" totalImagesPullingTime="19.648892789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:37.218862057 +0000 UTC m=+23.788737354" watchObservedRunningTime="2026-07-15 16:40:37.219893311 +0000 UTC m=+23.789768608"
Jul 15 16:40:37.235261 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.235208    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-smvl6" podStartSLOduration=3.423496779 podStartE2EDuration="23.23519024s" totalImagesPullingTime="19.811693461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:37.235049036 +0000 UTC m=+23.804924348" watchObservedRunningTime="2026-07-15 16:40:37.23519024 +0000 UTC m=+23.805065536"
Jul 15 16:40:37.525707 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.525681    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 16:40:37.921502 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.921402    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T16:40:37.525701354Z","UUID":"e7e351dd-a10c-4e88-b870-2ca3b9714cb0","Handler":null,"Name":"","Endpoint":""}
Jul 15 16:40:37.922999 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.922970    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 16:40:37.923124 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:37.923012    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 16:40:38.021614 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:38.021582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:38.022184 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:38.021617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:38.022184 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:38.021717    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:38.022184 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:38.021835    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:38.137953 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:38.137914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b9vz4" event={"ID":"7d9d3e8e-c6d4-499f-9c73-458ce73b9c24","Type":"ContainerStarted","Data":"e6421cf7ae8f89d55f8c41ad374629ea4121e7866970c50ae0475c69f8af8929"}
Jul 15 16:40:38.140283 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:38.140249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t" event={"ID":"1fff4afe-dbb3-4255-9254-ca1e96775047","Type":"ContainerStarted","Data":"0a4fe076bade47e720d3951b0e2f24ecedbc9f0da1443144dab9619d6b2ceac6"}
Jul 15 16:40:38.155205 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:38.155144    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b9vz4" podStartSLOduration=4.453598262 podStartE2EDuration="24.155125894s" totalImagesPullingTime="19.701527632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:38.154837694 +0000 UTC m=+24.724712990" watchObservedRunningTime="2026-07-15 16:40:38.155125894 +0000 UTC m=+24.725001190"
Jul 15 16:40:39.018864 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.018567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:39.019067 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:39.018929    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:39.145531 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.145490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t" event={"ID":"1fff4afe-dbb3-4255-9254-ca1e96775047","Type":"ContainerStarted","Data":"2ab9b43d5252ef166508cc36ab1af838a157da695f4eba637d279a19273a742c"}
Jul 15 16:40:39.152118 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.152083    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:40:39.152512 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.152484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"b855fb3a8a47feda3f5b500211c6aec1e2ea4dbea527d9aa4fbdab10a2289f62"}
Jul 15 16:40:39.168069 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.168018    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m679t" podStartSLOduration=3.023527064 podStartE2EDuration="25.168002516s" totalImagesPullingTime="22.144475452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:39.167732381 +0000 UTC m=+25.737607678" watchObservedRunningTime="2026-07-15 16:40:39.168002516 +0000 UTC m=+25.737877813"
Jul 15 16:40:39.800291 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.800233    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:39.800924 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:39.800901    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:40.018253 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:40.018216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:40.018253 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:40.018244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:40.018494 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:40.018346    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:40.018553 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:40.018505    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:40.155560 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:40.155529    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:40.156220 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:40.156196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-29mdj"
Jul 15 16:40:41.018457 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:41.018423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:41.018652 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:41.018547    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:42.018404 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.018198    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:42.022170 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.018201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:42.022170 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:42.018949    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:42.022170 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:42.019008    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:42.163466 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.163437    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:40:42.163851 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.163823    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"3796bf0e730261ff12c37b5f83e6c5a34cd9b3077aca255eeb66c50657b30068"}
Jul 15 16:40:42.164231 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.164201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:42.164357 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.164332    2575 scope.go:117] "RemoveContainer" containerID="3ff60713a8add7219adcaac521538e695450d0c075c5fb972bc86c988baa9e8e"
Jul 15 16:40:42.165882 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.165853    2575 generic.go:356] "Generic (PLEG): container finished" podID="af4944f4-8a9f-469d-968f-efb49eeeac8b" containerID="0f0f994dfa8745163f65f88c7af4ae596a31a23e84dd23c1de241b92342af3f6" exitCode=0
Jul 15 16:40:42.165976 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.165942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerDied","Data":"0f0f994dfa8745163f65f88c7af4ae596a31a23e84dd23c1de241b92342af3f6"}
Jul 15 16:40:42.181571 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:42.181548    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:43.018626 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.018592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:43.019206 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:43.018730    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:43.172633 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.172606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:40:43.174960 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.174917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" event={"ID":"b888e67a-0695-497b-827f-59fb831bdad3","Type":"ContainerStarted","Data":"86b57e4c9e29dae5c5bcb8816cfc41a6abf6a87067fe45259aaa01bc8772043b"}
Jul 15 16:40:43.175383 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.175251    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:43.175383 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.175333    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:43.193439 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.193409    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:40:43.208003 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.207946    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq" podStartSLOduration=9.413210754 podStartE2EDuration="29.207930422s" totalImagesPullingTime="19.794719668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:43.20767917 +0000 UTC m=+29.777554467" watchObservedRunningTime="2026-07-15 16:40:43.207930422 +0000 UTC m=+29.777805718"
Jul 15 16:40:43.514802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.514538    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v8ln4"]
Jul 15 16:40:43.514950 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.514940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:43.515051 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:43.515032    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:43.517127 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.517102    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dg7fn"]
Jul 15 16:40:43.517270 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.517223    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:43.517365 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:43.517346    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:43.525117 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.525091    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4xjf"]
Jul 15 16:40:43.525249 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:43.525204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:43.525324 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:43.525305    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:44.179337 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:44.179300    2575 generic.go:356] "Generic (PLEG): container finished" podID="af4944f4-8a9f-469d-968f-efb49eeeac8b" containerID="fc35736113d5fcf987594c40da661e7eff7eb32d766160f3c49673bcb03ad071" exitCode=0
Jul 15 16:40:44.179864 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:44.179386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerDied","Data":"fc35736113d5fcf987594c40da661e7eff7eb32d766160f3c49673bcb03ad071"}
Jul 15 16:40:44.912467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:44.912417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:45.018066 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:45.018029    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:45.018235 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:45.018136    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:45.018235 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:45.018141    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:45.018235 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:45.018190    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:45.018344 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:45.018265    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:45.018377 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:45.018340    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:45.072153 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:45.072120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:45.228995 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:45.228963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:45.327944 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:45.327920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:46.185543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:46.185514    2575 generic.go:356] "Generic (PLEG): container finished" podID="af4944f4-8a9f-469d-968f-efb49eeeac8b" containerID="8f067f32d622a404a92636f310b9b1d307cde61909832f9f3aa67a445ba0a5bc" exitCode=0
Jul 15 16:40:46.185692 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:46.185568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerDied","Data":"8f067f32d622a404a92636f310b9b1d307cde61909832f9f3aa67a445ba0a5bc"}
Jul 15 16:40:47.018196 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:47.018150    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:47.018196 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:47.018185    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:47.018196 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:47.018191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:47.019061 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.018287    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:47.019061 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.018405    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:47.019061 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.018497    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:47.626169 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:47.625932    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:47.626340 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.626100    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:47.626340 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.626315    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret podName:0b995a7c-f16e-4733-ac64-d05c9c089497 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.626290329 +0000 UTC m=+66.196165611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret") pod "global-pull-secret-syncer-g4xjf" (UID: "0b995a7c-f16e-4733-ac64-d05c9c089497") : object "kube-system"/"original-pull-secret" not registered
Jul 15 16:40:47.727335 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:47.727299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:47.727548 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.727471    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:47.727616 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.727550    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.727527534 +0000 UTC m=+66.297402809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 16:40:47.828517 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:47.828477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:47.828718 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.828676    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 16:40:47.828718 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.828702    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 16:40:47.828718 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.828714    2575 projected.go:196] Error preparing data for projected volume kube-api-access-7cjqj for pod openshift-network-diagnostics/network-check-target-v8ln4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:47.828904 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:47.828780    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj podName:30b2a90c-2b42-4996-9148-6ad54ca2322f nodeName:}" failed. No retries permitted until 2026-07-15 16:41:19.828760932 +0000 UTC m=+66.398636224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cjqj" (UniqueName: "kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj") pod "network-check-target-v8ln4" (UID: "30b2a90c-2b42-4996-9148-6ad54ca2322f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 16:40:48.175275 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:48.175242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:48.274554 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:48.274519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:49.018045 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.018008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:49.018045 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.018042    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:49.018291 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.018042    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:49.018291 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:49.018129    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:40:49.018291 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:49.018220    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v8ln4" podUID="30b2a90c-2b42-4996-9148-6ad54ca2322f"
Jul 15 16:40:49.018291 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:49.018279    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4xjf" podUID="0b995a7c-f16e-4733-ac64-d05c9c089497"
Jul 15 16:40:49.239201 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.239086    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-165.ec2.internal" event="NodeReady"
Jul 15 16:40:49.239651 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.239235    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 16:40:49.287752 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.287717    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cszs7"]
Jul 15 16:40:49.290105 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.290072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.291173 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.291146    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4xvnw"]
Jul 15 16:40:49.292704 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.292686    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 16:40:49.293061 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.293041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.293628 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.293609    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 16:40:49.293756 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.293609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gzkx\""
Jul 15 16:40:49.295606 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.295483    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 16:40:49.295745 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.295625    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 16:40:49.295745 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.295638    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 16:40:49.295745 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.295701    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-554wc\""
Jul 15 16:40:49.302741 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.302697    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cszs7"]
Jul 15 16:40:49.305386 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.305363    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xvnw"]
Jul 15 16:40:49.440109 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.440074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894d176c-ac2c-4562-82df-3c58378aa6eb-tmp-dir\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.440297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.440132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c00c3351-8a70-459d-a6ea-e7ff30898a78-cert\") pod \"ingress-canary-4xvnw\" (UID: \"c00c3351-8a70-459d-a6ea-e7ff30898a78\") " pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.440297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.440163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.440297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.440236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kvfx\" (UniqueName: \"kubernetes.io/projected/894d176c-ac2c-4562-82df-3c58378aa6eb-kube-api-access-9kvfx\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.440297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.440295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/894d176c-ac2c-4562-82df-3c58378aa6eb-config-volume\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.440466 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.440315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmkbg\" (UniqueName: \"kubernetes.io/projected/c00c3351-8a70-459d-a6ea-e7ff30898a78-kube-api-access-lmkbg\") pod \"ingress-canary-4xvnw\" (UID: \"c00c3351-8a70-459d-a6ea-e7ff30898a78\") " pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.540736 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.540650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/894d176c-ac2c-4562-82df-3c58378aa6eb-config-volume\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.540736 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.540693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmkbg\" (UniqueName: \"kubernetes.io/projected/c00c3351-8a70-459d-a6ea-e7ff30898a78-kube-api-access-lmkbg\") pod \"ingress-canary-4xvnw\" (UID: \"c00c3351-8a70-459d-a6ea-e7ff30898a78\") " pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.540736 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.540731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894d176c-ac2c-4562-82df-3c58378aa6eb-tmp-dir\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.541092 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.540769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c00c3351-8a70-459d-a6ea-e7ff30898a78-cert\") pod \"ingress-canary-4xvnw\" (UID: \"c00c3351-8a70-459d-a6ea-e7ff30898a78\") " pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.541092 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.540807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.541092 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.540860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kvfx\" (UniqueName: \"kubernetes.io/projected/894d176c-ac2c-4562-82df-3c58378aa6eb-kube-api-access-9kvfx\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.541092 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:49.540907    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:49.541092 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:49.540974    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:40:50.040952903 +0000 UTC m=+36.610828178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:49.541314 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.541187    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/894d176c-ac2c-4562-82df-3c58378aa6eb-tmp-dir\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.541441 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.541420    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/894d176c-ac2c-4562-82df-3c58378aa6eb-config-volume\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.545738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.545715    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c00c3351-8a70-459d-a6ea-e7ff30898a78-cert\") pod \"ingress-canary-4xvnw\" (UID: \"c00c3351-8a70-459d-a6ea-e7ff30898a78\") " pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.549814 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.549773    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmkbg\" (UniqueName: \"kubernetes.io/projected/c00c3351-8a70-459d-a6ea-e7ff30898a78-kube-api-access-lmkbg\") pod \"ingress-canary-4xvnw\" (UID: \"c00c3351-8a70-459d-a6ea-e7ff30898a78\") " pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:49.549814 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.549782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kvfx\" (UniqueName: \"kubernetes.io/projected/894d176c-ac2c-4562-82df-3c58378aa6eb-kube-api-access-9kvfx\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:49.610678 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:49.610637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xvnw"
Jul 15 16:40:50.043437 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:50.043401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:50.043619 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:50.043559    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:50.043695 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:50.043648    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:40:51.043625978 +0000 UTC m=+37.613501256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:50.762845 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:50.762765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xvnw"]
Jul 15 16:40:50.766959 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:40:50.766714    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00c3351_8a70_459d_a6ea_e7ff30898a78.slice/crio-b28f0a4e8c1eb0c74de7895efcd0e571e085c1d7186fe5b99cf5c037ec834432 WatchSource:0}: Error finding container b28f0a4e8c1eb0c74de7895efcd0e571e085c1d7186fe5b99cf5c037ec834432: Status 404 returned error can't find the container with id b28f0a4e8c1eb0c74de7895efcd0e571e085c1d7186fe5b99cf5c037ec834432
Jul 15 16:40:51.018459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.018365    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:40:51.018609 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.018365    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:40:51.018609 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.018365    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:40:51.021394 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.021376    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 16:40:51.022682 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.022661    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:40:51.022993 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.022964    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlftd\""
Jul 15 16:40:51.023130 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.023115    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 16:40:51.026021 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.023644    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:40:51.026021 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.024089    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p9xs\""
Jul 15 16:40:51.050610 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.050580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:51.050769 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:51.050751    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:51.050864 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:51.050843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:40:53.05082035 +0000 UTC m=+39.620695638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:51.200740 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.200701    2575 generic.go:356] "Generic (PLEG): container finished" podID="af4944f4-8a9f-469d-968f-efb49eeeac8b" containerID="bccdc1015fc0101c3e23663b7b0f0c12771296a2da68932f6df009e67b9095cd" exitCode=0
Jul 15 16:40:51.200931 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.200751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerDied","Data":"bccdc1015fc0101c3e23663b7b0f0c12771296a2da68932f6df009e67b9095cd"}
Jul 15 16:40:51.201950 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:51.201915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xvnw" event={"ID":"c00c3351-8a70-459d-a6ea-e7ff30898a78","Type":"ContainerStarted","Data":"b28f0a4e8c1eb0c74de7895efcd0e571e085c1d7186fe5b99cf5c037ec834432"}
Jul 15 16:40:52.208292 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:52.208254    2575 generic.go:356] "Generic (PLEG): container finished" podID="af4944f4-8a9f-469d-968f-efb49eeeac8b" containerID="380ab6b8bc89a4d7609131ce01678820224533814e69324717e4492bcc40f263" exitCode=0
Jul 15 16:40:52.208814 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:52.208339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerDied","Data":"380ab6b8bc89a4d7609131ce01678820224533814e69324717e4492bcc40f263"}
Jul 15 16:40:53.065059 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.065022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:53.065222 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:53.065173    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:53.065272 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:53.065248    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:40:57.065223472 +0000 UTC m=+43.635098747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:40:53.214466 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.214386    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" event={"ID":"af4944f4-8a9f-469d-968f-efb49eeeac8b","Type":"ContainerStarted","Data":"a118fad6bfd1c850284c3564e83511f37c5b107649b1de2d2c3aa56f7de24b8f"}
Jul 15 16:40:53.237439 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.237388    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bkd6k" podStartSLOduration=8.464452111 podStartE2EDuration="39.237369209s" totalImagesPullingTime="30.772917098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:53.236190219 +0000 UTC m=+39.806065516" watchObservedRunningTime="2026-07-15 16:40:53.237369209 +0000 UTC m=+39.807244507"
Jul 15 16:40:53.358159 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.358136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:53.457642 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.457617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:53.575393 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.575344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:53.635143 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.635110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:53.753511 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.753475    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:53.823537 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:53.823504    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:54.218374 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:54.218334    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xvnw" event={"ID":"c00c3351-8a70-459d-a6ea-e7ff30898a78","Type":"ContainerStarted","Data":"2ad947f7aef184bbe3573dfd10a1c0613eb80b03d0e90d21abf4aa7c6fab51e6"}
Jul 15 16:40:54.237255 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:54.237192    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4xvnw" podStartSLOduration=2.6528698840000002 podStartE2EDuration="5.23717548s" totalImagesPullingTime="2.584305596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:40:54.236307821 +0000 UTC m=+40.806183129" watchObservedRunningTime="2026-07-15 16:40:54.23717548 +0000 UTC m=+40.807050775"
Jul 15 16:40:55.515693 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:55.515660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:55.568690 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:55.568659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:40:57.090623 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:40:57.090585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:40:57.091044 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:57.090708    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:40:57.091044 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:40:57.090767    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:41:05.090750399 +0000 UTC m=+51.660625693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:05.148762 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:05.148719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:41:05.149290 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:05.148892    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:41:05.149290 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:05.148973    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:41:21.148955962 +0000 UTC m=+67.718831236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:06.853425 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:06.853386    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:06.951161 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:06.951127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:14.479080 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:14.479029    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:14.530375 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:14.530344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:15.206671 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:15.206643    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vpvmq"
Jul 15 16:41:15.318577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:15.318543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:18.068277 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:18.068224    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:19.651501 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.651448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:41:19.654167 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.654143    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 16:41:19.665512 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.665479    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b995a7c-f16e-4733-ac64-d05c9c089497-original-pull-secret\") pod \"global-pull-secret-syncer-g4xjf\" (UID: \"0b995a7c-f16e-4733-ac64-d05c9c089497\") " pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:41:19.751881 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.751844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:41:19.754702 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.754685    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 16:41:19.762673 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:19.762651    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 16:41:19.762751 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:19.762731    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:23.762713368 +0000 UTC m=+130.332588645 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : secret "metrics-daemon-secret" not found
Jul 15 16:41:19.834728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.834688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4xjf"
Jul 15 16:41:19.852928 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.852893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:41:19.855867 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.855841    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 16:41:19.866160 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.866129    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 16:41:19.877145 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.877112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjqj\" (UniqueName: \"kubernetes.io/projected/30b2a90c-2b42-4996-9148-6ad54ca2322f-kube-api-access-7cjqj\") pod \"network-check-target-v8ln4\" (UID: \"30b2a90c-2b42-4996-9148-6ad54ca2322f\") " pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:41:19.958578 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:19.958539    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4xjf"]
Jul 15 16:41:19.962463 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:41:19.962433    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b995a7c_f16e_4733_ac64_d05c9c089497.slice/crio-0ed915cdece2d391a428b62939e60758b6831283e745365dbebde4971ddde215 WatchSource:0}: Error finding container 0ed915cdece2d391a428b62939e60758b6831283e745365dbebde4971ddde215: Status 404 returned error can't find the container with id 0ed915cdece2d391a428b62939e60758b6831283e745365dbebde4971ddde215
Jul 15 16:41:20.141690 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:20.141658    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlftd\""
Jul 15 16:41:20.149515 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:20.149479    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:41:20.278515 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:20.278478    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4xjf" event={"ID":"0b995a7c-f16e-4733-ac64-d05c9c089497","Type":"ContainerStarted","Data":"0ed915cdece2d391a428b62939e60758b6831283e745365dbebde4971ddde215"}
Jul 15 16:41:20.294839 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:20.294810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v8ln4"]
Jul 15 16:41:20.298536 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:41:20.298506    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b2a90c_2b42_4996_9148_6ad54ca2322f.slice/crio-e86f35fcceddacf0bd7d7bf7b6d5045245373d3e96a5b44a1053dd92983876be WatchSource:0}: Error finding container e86f35fcceddacf0bd7d7bf7b6d5045245373d3e96a5b44a1053dd92983876be: Status 404 returned error can't find the container with id e86f35fcceddacf0bd7d7bf7b6d5045245373d3e96a5b44a1053dd92983876be
Jul 15 16:41:20.505832 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:20.505737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:20.606869 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:20.606801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:21.163540 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:21.163509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:41:21.164072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:21.163650    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:41:21.164072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:21.163730    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:41:53.163707175 +0000 UTC m=+99.733582452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:21.283053 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:21.283012    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v8ln4" event={"ID":"30b2a90c-2b42-4996-9148-6ad54ca2322f","Type":"ContainerStarted","Data":"e86f35fcceddacf0bd7d7bf7b6d5045245373d3e96a5b44a1053dd92983876be"}
Jul 15 16:41:25.300068 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:25.299965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4xjf" event={"ID":"0b995a7c-f16e-4733-ac64-d05c9c089497","Type":"ContainerStarted","Data":"a8a103153a4de953ee781fe21037a1874bf1ea36ecae9c6df236b7a5fb390892"}
Jul 15 16:41:25.301456 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:25.301433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v8ln4" event={"ID":"30b2a90c-2b42-4996-9148-6ad54ca2322f","Type":"ContainerStarted","Data":"4504e05417fc99e868d1591c245ef42dafb51a584379334038fc0d5099f72790"}
Jul 15 16:41:25.301592 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:25.301570    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:41:25.315895 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:25.315848    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g4xjf" podStartSLOduration=66.438725756 podStartE2EDuration="1m11.315833429s" totalImagesPullingTime="4.877107673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:25.315133083 +0000 UTC m=+71.885008379" watchObservedRunningTime="2026-07-15 16:41:25.315833429 +0000 UTC m=+71.885708725"
Jul 15 16:41:25.329815 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:25.329749    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v8ln4" podStartSLOduration=66.788495538 podStartE2EDuration="1m11.329731582s" totalImagesPullingTime="4.541236044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:41:25.329429614 +0000 UTC m=+71.899304914" watchObservedRunningTime="2026-07-15 16:41:25.329731582 +0000 UTC m=+71.899606878"
Jul 15 16:41:32.699624 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:32.699579    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:38.195489 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:38.195335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:41:53.194430 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:53.194345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:41:53.194842 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:53.194479    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:41:53.194842 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:41:53.194542    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.194523022 +0000 UTC m=+163.764398300 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:41:56.305881 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:41:56.305843    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v8ln4"
Jul 15 16:42:23.809514 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:23.809456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:42:23.810058 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:23.809617    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 16:42:23.810058 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:23.809689    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs podName:0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38 nodeName:}" failed. No retries permitted until 2026-07-15 16:44:25.809668932 +0000 UTC m=+252.379544209 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs") pod "network-metrics-daemon-dg7fn" (UID: "0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38") : secret "metrics-daemon-secret" not found
Jul 15 16:42:51.174556 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.174517    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"]
Jul 15 16:42:51.176382 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.176362    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"]
Jul 15 16:42:51.176519 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.176502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.178161 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.178142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.178937 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.178917    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:42:51.179207 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.179190    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 16:42:51.179427 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.179413    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 16:42:51.179572 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.179553    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2xhr9\""
Jul 15 16:42:51.180402 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3e7bf8-1b18-474c-a724-977437d34227-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.180487 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqtc\" (UniqueName: \"kubernetes.io/projected/1478d04f-b6e7-4870-ac4a-7341205f1dc8-kube-api-access-5vqtc\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.180551 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c3e7bf8-1b18-474c-a724-977437d34227-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.180551 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1478d04f-b6e7-4870-ac4a-7341205f1dc8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.180653 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.180653 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjcm6\" (UniqueName: \"kubernetes.io/projected/4c3e7bf8-1b18-474c-a724-977437d34227-kube-api-access-kjcm6\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.180769 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.180752    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c2m2m\""
Jul 15 16:42:51.182091 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.182040    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 16:42:51.182091 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.182062    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 16:42:51.182091 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.182046    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 16:42:51.182286 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.182078    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 16:42:51.182868 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.182838    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 16:42:51.188532 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.188513    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"]
Jul 15 16:42:51.191440 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.191346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"]
Jul 15 16:42:51.270234 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.270179    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7496cb7dcd-n7klc"]
Jul 15 16:42:51.272344 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.272325    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"]
Jul 15 16:42:51.272466 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.272452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.273950 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.273931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.277615 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.277592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 16:42:51.277816 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.277712    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 16:42:51.277816 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.277724    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 16:42:51.277936 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.277895    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rbvr8\""
Jul 15 16:42:51.277936 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.277895    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 16:42:51.278558 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.278544    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 16:42:51.278643 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.278546    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 16:42:51.278771 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.278756    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 16:42:51.279598 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.279575    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 16:42:51.279598 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.279591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cbbw5\""
Jul 15 16:42:51.279737 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.279604    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 16:42:51.281665 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.281636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-bound-sa-token\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.281746 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.281706    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.281833 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.281750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.281833 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.281802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-stats-auth\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.281994 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.281975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-image-registry-private-configuration\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.282048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjcm6\" (UniqueName: \"kubernetes.io/projected/4c3e7bf8-1b18-474c-a724-977437d34227-kube-api-access-kjcm6\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.282098 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-default-certificate\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.282243 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.282298 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-certificates\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.282353 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3e7bf8-1b18-474c-a724-977437d34227-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.282401 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8r9\" (UniqueName: \"kubernetes.io/projected/4b2e7712-5c21-4423-95ab-fd4fc27eb129-kube-api-access-zz8r9\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.282465 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e069128c-71f4-436b-b9e1-ba356fdf1429-ca-trust-extracted\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.282593 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-installation-pull-secrets\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.282644 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqtc\" (UniqueName: \"kubernetes.io/projected/1478d04f-b6e7-4870-ac4a-7341205f1dc8-kube-api-access-5vqtc\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.282694 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2k6\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-kube-api-access-mn2k6\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.282739 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c3e7bf8-1b18-474c-a724-977437d34227-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.282803 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1478d04f-b6e7-4870-ac4a-7341205f1dc8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.282857 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.282857 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.282844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-trusted-ca\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.283073 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.283056    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:51.283717 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.283634    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls podName:1478d04f-b6e7-4870-ac4a-7341205f1dc8 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:51.783601513 +0000 UTC m=+158.353476800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-td7vf" (UID: "1478d04f-b6e7-4870-ac4a-7341205f1dc8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:51.284954 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.284928    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c3e7bf8-1b18-474c-a724-977437d34227-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.286019 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.285993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3e7bf8-1b18-474c-a724-977437d34227-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.286111 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.286048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1478d04f-b6e7-4870-ac4a-7341205f1dc8-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.288059 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.288014    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 16:42:51.289538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.289521    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7496cb7dcd-n7klc"]
Jul 15 16:42:51.294533 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.294511    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"]
Jul 15 16:42:51.301072 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.301048    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjcm6\" (UniqueName: \"kubernetes.io/projected/4c3e7bf8-1b18-474c-a724-977437d34227-kube-api-access-kjcm6\") pod \"kube-storage-version-migrator-operator-799cb7f958-nr4z9\" (UID: \"4c3e7bf8-1b18-474c-a724-977437d34227\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.303313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.303287    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqtc\" (UniqueName: \"kubernetes.io/projected/1478d04f-b6e7-4870-ac4a-7341205f1dc8-kube-api-access-5vqtc\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.384230 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-image-registry-private-configuration\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384230 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-default-certificate\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-certificates\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8r9\" (UniqueName: \"kubernetes.io/projected/4b2e7712-5c21-4423-95ab-fd4fc27eb129-kube-api-access-zz8r9\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e069128c-71f4-436b-b9e1-ba356fdf1429-ca-trust-extracted\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-installation-pull-secrets\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2k6\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-kube-api-access-mn2k6\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.384472    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:42:51.384496 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.384494    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbd99c7b4-zlgpg: secret "image-registry-tls" not found
Jul 15 16:42:51.384942 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-trusted-ca\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384942 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.384571    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls podName:e069128c-71f4-436b-b9e1-ba356fdf1429 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:51.884549981 +0000 UTC m=+158.454425270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls") pod "image-registry-6cbd99c7b4-zlgpg" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429") : secret "image-registry-tls" not found
Jul 15 16:42:51.384942 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-bound-sa-token\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.384942 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.384942 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.384812    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:51.884775918 +0000 UTC m=+158.454651198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : configmap references non-existent config key: service-ca.crt
Jul 15 16:42:51.384942 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384857    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e069128c-71f4-436b-b9e1-ba356fdf1429-ca-trust-extracted\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.385252 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.384956    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:42:51.385252 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.384954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-stats-auth\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.385252 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.385015    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:51.885000412 +0000 UTC m=+158.454875688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : secret "router-metrics-certs-default" not found
Jul 15 16:42:51.385252 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.385162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-certificates\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.385964 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.385943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-trusted-ca\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.387134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.387106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-installation-pull-secrets\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.387313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.387296    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-image-registry-private-configuration\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.387459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.387437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-stats-auth\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.387498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.387437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-default-certificate\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.393032 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.393006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8r9\" (UniqueName: \"kubernetes.io/projected/4b2e7712-5c21-4423-95ab-fd4fc27eb129-kube-api-access-zz8r9\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.393261 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.393228    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-bound-sa-token\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.393506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.393487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2k6\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-kube-api-access-mn2k6\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.421723 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.421687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:51.476197 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.476127    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:51.487302 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.487275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"
Jul 15 16:42:51.612707 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.612675    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9"]
Jul 15 16:42:51.615842 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:42:51.615813    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3e7bf8_1b18_474c_a724_977437d34227.slice/crio-0e3313e0bb748fa7631de7733ffdadf2093d5ac6b1090a96e761c7c848024558 WatchSource:0}: Error finding container 0e3313e0bb748fa7631de7733ffdadf2093d5ac6b1090a96e761c7c848024558: Status 404 returned error can't find the container with id 0e3313e0bb748fa7631de7733ffdadf2093d5ac6b1090a96e761c7c848024558
Jul 15 16:42:51.787131 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.787038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:51.787279 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.787196    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:51.787279 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.787277    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls podName:1478d04f-b6e7-4870-ac4a-7341205f1dc8 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:52.787260488 +0000 UTC m=+159.357135761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-td7vf" (UID: "1478d04f-b6e7-4870-ac4a-7341205f1dc8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:51.888094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.888051    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.888094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.888102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:51.888293 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:51.888126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:51.888293 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.888196    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:42:51.888293 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.888223    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:42:51.888293 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.888233    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbd99c7b4-zlgpg: secret "image-registry-tls" not found
Jul 15 16:42:51.888293 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.888271    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:52.888253141 +0000 UTC m=+159.458128420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : configmap references non-existent config key: service-ca.crt
Jul 15 16:42:51.888293 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.888292    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls podName:e069128c-71f4-436b-b9e1-ba356fdf1429 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:52.888284239 +0000 UTC m=+159.458159513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls") pod "image-registry-6cbd99c7b4-zlgpg" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429") : secret "image-registry-tls" not found
Jul 15 16:42:51.888481 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:51.888302    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:52.888296788 +0000 UTC m=+159.458172061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : secret "router-metrics-certs-default" not found
Jul 15 16:42:52.303859 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.303780    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cszs7" podUID="894d176c-ac2c-4562-82df-3c58378aa6eb"
Jul 15 16:42:52.510151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:52.510111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9" event={"ID":"4c3e7bf8-1b18-474c-a724-977437d34227","Type":"ContainerStarted","Data":"0e3313e0bb748fa7631de7733ffdadf2093d5ac6b1090a96e761c7c848024558"}
Jul 15 16:42:52.510151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:52.510151    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cszs7"
Jul 15 16:42:52.795137 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:52.795094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:52.795329 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.795264    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:52.795383 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.795333    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls podName:1478d04f-b6e7-4870-ac4a-7341205f1dc8 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:54.795315523 +0000 UTC m=+161.365190797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-td7vf" (UID: "1478d04f-b6e7-4870-ac4a-7341205f1dc8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:52.896525 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:52.896484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:52.896729 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:52.896544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:52.896729 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:52.896585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:52.896729 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.896645    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:42:52.896729 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.896699    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:42:52.896729 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.896712    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbd99c7b4-zlgpg: secret "image-registry-tls" not found
Jul 15 16:42:52.896729 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.896719    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:54.896700537 +0000 UTC m=+161.466575824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : secret "router-metrics-certs-default" not found
Jul 15 16:42:52.896982 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.896737    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:54.8967288 +0000 UTC m=+161.466604074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : configmap references non-existent config key: service-ca.crt
Jul 15 16:42:52.896982 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:52.896750    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls podName:e069128c-71f4-436b-b9e1-ba356fdf1429 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:54.896743605 +0000 UTC m=+161.466618879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls") pod "image-registry-6cbd99c7b4-zlgpg" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429") : secret "image-registry-tls" not found
Jul 15 16:42:53.725421 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:53.725391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:54.029894 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.029806    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dg7fn" podUID="0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38"
Jul 15 16:42:54.516850 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:54.516812    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9" event={"ID":"4c3e7bf8-1b18-474c-a724-977437d34227","Type":"ContainerStarted","Data":"6e578982c5aafb02ad8dff737750a7104ff12bea91e9fdfd44f5b0449e3cda79"}
Jul 15 16:42:54.533379 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:54.533323    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9" podStartSLOduration=1.4686926630000001 podStartE2EDuration="3.533308179s" totalImagesPullingTime="2.064615516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:42:54.532942692 +0000 UTC m=+161.102817989" watchObservedRunningTime="2026-07-15 16:42:54.533308179 +0000 UTC m=+161.103183474"
Jul 15 16:42:54.812241 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:54.812134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:54.812732 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.812265    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:54.812732 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.812352    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls podName:1478d04f-b6e7-4870-ac4a-7341205f1dc8 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.812329015 +0000 UTC m=+165.382204295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-td7vf" (UID: "1478d04f-b6e7-4870-ac4a-7341205f1dc8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:54.912897 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:54.912858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:54.913095 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:54.912921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:54.913095 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:54.912961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:54.913095 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.913017    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:42:54.913095 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.913085    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.913068749 +0000 UTC m=+165.482944023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : secret "router-metrics-certs-default" not found
Jul 15 16:42:54.913095 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.913099    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.9130928 +0000 UTC m=+165.482968074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : configmap references non-existent config key: service-ca.crt
Jul 15 16:42:54.913321 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.913110    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:42:54.913321 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.913124    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbd99c7b4-zlgpg: secret "image-registry-tls" not found
Jul 15 16:42:54.913321 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:54.913184    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls podName:e069128c-71f4-436b-b9e1-ba356fdf1429 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.913168549 +0000 UTC m=+165.483043839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls") pod "image-registry-6cbd99c7b4-zlgpg" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429") : secret "image-registry-tls" not found
Jul 15 16:42:55.087419 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:55.087382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:55.187608 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:55.187576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:56.391538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.391508    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6tm"]
Jul 15 16:42:56.393446 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.393430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.396184 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.396162    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 16:42:56.396361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.396187    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 16:42:56.396361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.396202    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 16:42:56.396906 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.396890    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 16:42:56.396974 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.396889    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r79jc\""
Jul 15 16:42:56.403156 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.403135    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6tm"]
Jul 15 16:42:56.425612 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.425576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.425612 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.425611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3bb2c3c-ee45-482a-b3e9-4766df52e299-crio-socket\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.425865 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.425696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.425865 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.425744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3bb2c3c-ee45-482a-b3e9-4766df52e299-data-volume\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.425865 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.425812    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv5kr\" (UniqueName: \"kubernetes.io/projected/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-api-access-wv5kr\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.526574 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.526574 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3bb2c3c-ee45-482a-b3e9-4766df52e299-data-volume\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.526914 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv5kr\" (UniqueName: \"kubernetes.io/projected/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-api-access-wv5kr\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.526914 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:56.526707    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:56.526914 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:56.526779    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.026760923 +0000 UTC m=+163.596636200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:56.526914 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.526914 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3bb2c3c-ee45-482a-b3e9-4766df52e299-crio-socket\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.526914 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526908    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3bb2c3c-ee45-482a-b3e9-4766df52e299-data-volume\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.527182 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:56.526949    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:42:56.527182 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.526974    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3bb2c3c-ee45-482a-b3e9-4766df52e299-crio-socket\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:56.527182 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:56.527007    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:57.026992583 +0000 UTC m=+163.596867868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : configmap "kube-rbac-proxy" not found
Jul 15 16:42:56.536281 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:56.536250    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv5kr\" (UniqueName: \"kubernetes.io/projected/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-api-access-wv5kr\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:57.031527 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:57.031473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:57.031823 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:57.031587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:57.031823 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:57.031636    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:57.031823 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:57.031670    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:42:57.031823 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:57.031705    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.031689465 +0000 UTC m=+164.601564739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:57.031823 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:57.031722    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:42:58.031712945 +0000 UTC m=+164.601588219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : configmap "kube-rbac-proxy" not found
Jul 15 16:42:57.233504 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:57.233460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:42:57.233678 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:57.233625    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 16:42:57.233727 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:57.233703    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls podName:894d176c-ac2c-4562-82df-3c58378aa6eb nodeName:}" failed. No retries permitted until 2026-07-15 16:44:59.23368558 +0000 UTC m=+285.803560858 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls") pod "dns-default-cszs7" (UID: "894d176c-ac2c-4562-82df-3c58378aa6eb") : secret "dns-default-metrics-tls" not found
Jul 15 16:42:58.041364 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.041322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:58.041757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.041431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:42:58.041757 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.041495    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:58.041757 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.041516    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:42:58.041757 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.041563    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:00.041549104 +0000 UTC m=+166.611424377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : configmap "kube-rbac-proxy" not found
Jul 15 16:42:58.041757 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.041575    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:00.041569617 +0000 UTC m=+166.611444890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:42:58.141575 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.141539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:58.204644 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.204608    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:58.260760 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.260726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:58.848410 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.848356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:42:58.848599 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.848519    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:58.848599 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.848589    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls podName:1478d04f-b6e7-4870-ac4a-7341205f1dc8 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:06.848572122 +0000 UTC m=+173.418447401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-td7vf" (UID: "1478d04f-b6e7-4870-ac4a-7341205f1dc8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:42:58.949569 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.949513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:58.949569 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.949570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:42:58.949899 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.949683    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 16:42:58.949899 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.949696    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbd99c7b4-zlgpg: secret "image-registry-tls" not found
Jul 15 16:42:58.949899 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.949720    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:06.949696151 +0000 UTC m=+173.519571458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : configmap references non-existent config key: service-ca.crt
Jul 15 16:42:58.949899 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.949747    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls podName:e069128c-71f4-436b-b9e1-ba356fdf1429 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:06.949737522 +0000 UTC m=+173.519612797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls") pod "image-registry-6cbd99c7b4-zlgpg" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429") : secret "image-registry-tls" not found
Jul 15 16:42:58.949899 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:58.949773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:42:58.950122 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.949920    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 16:42:58.950122 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:42:58.949986    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:06.949971978 +0000 UTC m=+173.519847252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : secret "router-metrics-certs-default" not found
Jul 15 16:42:59.086662 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:59.086628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:42:59.387443 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:42:59.387416    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smvl6_ecb014ab-7df6-43ff-b6df-5164e09bde95/dns-node-resolver/0.log"
Jul 15 16:43:00.060094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:00.060057    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:00.060290 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:00.060152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:00.060290 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:00.060222    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:43:00.060290 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:00.060228    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:00.060290 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:00.060274    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:04.060260956 +0000 UTC m=+170.630136230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : configmap "kube-rbac-proxy" not found
Jul 15 16:43:00.060290 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:00.060287    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:04.060280651 +0000 UTC m=+170.630155925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:00.188870 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:00.188847    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlk9h_9b36c47c-a728-453c-94f3-c2e732977410/node-ca/0.log"
Jul 15 16:43:00.786506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:00.786480    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xvnw_c00c3351-8a70-459d-a6ea-e7ff30898a78/serve-healthcheck-canary/0.log"
Jul 15 16:43:00.952232 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:00.952198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:01.787695 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:01.787664    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-nr4z9_4c3e7bf8-1b18-474c-a724-977437d34227/kube-storage-version-migrator-operator/0.log"
Jul 15 16:43:04.017671 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:04.017630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:04.078239 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:04.078205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:04.097535 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:04.097499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:04.097618 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:04.097597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:04.097676 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:04.097663    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 16:43:04.097736 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:04.097728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:12.097712802 +0000 UTC m=+178.667588077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : configmap "kube-rbac-proxy" not found
Jul 15 16:43:04.097779 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:04.097667    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:04.097837 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:04.097824    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls podName:c3bb2c3c-ee45-482a-b3e9-4766df52e299 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:12.09780613 +0000 UTC m=+178.667681405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qb6tm" (UID: "c3bb2c3c-ee45-482a-b3e9-4766df52e299") : secret "insights-runtime-extractor-tls" not found
Jul 15 16:43:04.450247 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:04.450212    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:04.841541 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:04.841506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.049266 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.049231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.189037 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.188940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.290050 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.290016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.448379 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.448288    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.647156 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.647123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.697457 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.697431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:05.754019 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:05.753942    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:06.647543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:06.647511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:06.924038 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:06.923953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:43:06.924188 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:06.924114    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 16:43:06.924188 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:06.924182    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls podName:1478d04f-b6e7-4870-ac4a-7341205f1dc8 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:22.924165551 +0000 UTC m=+189.494040826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-td7vf" (UID: "1478d04f-b6e7-4870-ac4a-7341205f1dc8") : secret "cluster-monitoring-operator-tls" not found
Jul 15 16:43:07.024811 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.024755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:07.024811 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.024812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:43:07.025046 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.024840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:07.025046 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:07.024926    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle podName:4b2e7712-5c21-4423-95ab-fd4fc27eb129 nodeName:}" failed. No retries permitted until 2026-07-15 16:43:23.024906704 +0000 UTC m=+189.594781978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle") pod "router-default-7496cb7dcd-n7klc" (UID: "4b2e7712-5c21-4423-95ab-fd4fc27eb129") : configmap references non-existent config key: service-ca.crt
Jul 15 16:43:07.027281 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.027251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"image-registry-6cbd99c7b4-zlgpg\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") " pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:43:07.027418 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.027330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b2e7712-5c21-4423-95ab-fd4fc27eb129-metrics-certs\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:07.199012 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.198913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:43:07.330468 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.330443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"]
Jul 15 16:43:07.332715 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:07.332691    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode069128c_71f4_436b_b9e1_ba356fdf1429.slice/crio-10f5e958c0caf9da2cc6464ee4325f63e1fe33d4e0b53df6ecb58225b3124a9e WatchSource:0}: Error finding container 10f5e958c0caf9da2cc6464ee4325f63e1fe33d4e0b53df6ecb58225b3124a9e: Status 404 returned error can't find the container with id 10f5e958c0caf9da2cc6464ee4325f63e1fe33d4e0b53df6ecb58225b3124a9e
Jul 15 16:43:07.550406 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.550317    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" event={"ID":"e069128c-71f4-436b-b9e1-ba356fdf1429","Type":"ContainerStarted","Data":"1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf"}
Jul 15 16:43:07.550406 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.550364    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" event={"ID":"e069128c-71f4-436b-b9e1-ba356fdf1429","Type":"ContainerStarted","Data":"10f5e958c0caf9da2cc6464ee4325f63e1fe33d4e0b53df6ecb58225b3124a9e"}
Jul 15 16:43:07.550620 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.550458    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:43:07.568700 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:07.568633    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" podStartSLOduration=16.568611164 podStartE2EDuration="16.568611164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:07.568198666 +0000 UTC m=+174.138073963" watchObservedRunningTime="2026-07-15 16:43:07.568611164 +0000 UTC m=+174.138486461"
Jul 15 16:43:08.003403 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:08.003368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:08.246141 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:08.246104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:08.347738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:08.347699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:08.844956 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:08.844926    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:09.017692 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:09.017656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:43:09.245391 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:09.245293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:09.651157 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:09.651126    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:10.046237 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:10.046146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:10.444178 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:10.444141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:10.646426 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:10.646393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:11.249354 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:11.249310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:11.450070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:11.450034    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:11.670400 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:11.670366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:12.170752 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.170724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:12.170922 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.170808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:12.171411 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.171384    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3bb2c3c-ee45-482a-b3e9-4766df52e299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:12.172940 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.172911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3bb2c3c-ee45-482a-b3e9-4766df52e299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qb6tm\" (UID: \"c3bb2c3c-ee45-482a-b3e9-4766df52e299\") " pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:12.302762 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.302728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qb6tm"
Jul 15 16:43:12.435870 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.435769    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qb6tm"]
Jul 15 16:43:12.438679 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:12.438644    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bb2c3c_ee45_482a_b3e9_4766df52e299.slice/crio-b8609f5e6efd06f34dc199bbfca2f7964dbf8192b78ca53a80f10c66412deb0b WatchSource:0}: Error finding container b8609f5e6efd06f34dc199bbfca2f7964dbf8192b78ca53a80f10c66412deb0b: Status 404 returned error can't find the container with id b8609f5e6efd06f34dc199bbfca2f7964dbf8192b78ca53a80f10c66412deb0b
Jul 15 16:43:12.567022 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:12.566992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6tm" event={"ID":"c3bb2c3c-ee45-482a-b3e9-4766df52e299","Type":"ContainerStarted","Data":"b8609f5e6efd06f34dc199bbfca2f7964dbf8192b78ca53a80f10c66412deb0b"}
Jul 15 16:43:18.188613 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:18.188522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:18.263954 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:18.263913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:20.381584 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.381524    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"]
Jul 15 16:43:20.410859 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.410814    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56879b6cb7-gzz7m"]
Jul 15 16:43:20.412989 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.412961    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.429757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.429686    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56879b6cb7-gzz7m"]
Jul 15 16:43:20.477944 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.477904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:20.542497 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04fbdd42-e9a9-4a79-b166-b12da2fdd241-ca-trust-extracted\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.542702 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04fbdd42-e9a9-4a79-b166-b12da2fdd241-trusted-ca\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.542702 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04fbdd42-e9a9-4a79-b166-b12da2fdd241-installation-pull-secrets\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.542702 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-bound-sa-token\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.542702 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzq6\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-kube-api-access-xxzq6\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.542702 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-registry-tls\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.543009 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04fbdd42-e9a9-4a79-b166-b12da2fdd241-image-registry-private-configuration\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.543009 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.542833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04fbdd42-e9a9-4a79-b166-b12da2fdd241-registry-certificates\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.575817 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.575690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:20.596856 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.596817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6tm" event={"ID":"c3bb2c3c-ee45-482a-b3e9-4766df52e299","Type":"ContainerStarted","Data":"1b6fbd4d5f70488078711dcafaa73757356cbeae41767dab114e5a5bbc1d388b"}
Jul 15 16:43:20.643631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzq6\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-kube-api-access-xxzq6\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-registry-tls\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04fbdd42-e9a9-4a79-b166-b12da2fdd241-image-registry-private-configuration\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04fbdd42-e9a9-4a79-b166-b12da2fdd241-registry-certificates\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04fbdd42-e9a9-4a79-b166-b12da2fdd241-ca-trust-extracted\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04fbdd42-e9a9-4a79-b166-b12da2fdd241-trusted-ca\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04fbdd42-e9a9-4a79-b166-b12da2fdd241-installation-pull-secrets\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.643983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.643842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-bound-sa-token\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.644414 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.644381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/04fbdd42-e9a9-4a79-b166-b12da2fdd241-ca-trust-extracted\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.644841 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.644817    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/04fbdd42-e9a9-4a79-b166-b12da2fdd241-registry-certificates\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.645366 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.645302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/04fbdd42-e9a9-4a79-b166-b12da2fdd241-trusted-ca\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.647568 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.647540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/04fbdd42-e9a9-4a79-b166-b12da2fdd241-installation-pull-secrets\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.647672 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.647583    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-registry-tls\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.647733 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.647676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/04fbdd42-e9a9-4a79-b166-b12da2fdd241-image-registry-private-configuration\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.652135 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.652112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzq6\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-kube-api-access-xxzq6\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.652135 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.652124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04fbdd42-e9a9-4a79-b166-b12da2fdd241-bound-sa-token\") pod \"image-registry-56879b6cb7-gzz7m\" (UID: \"04fbdd42-e9a9-4a79-b166-b12da2fdd241\") " pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.726117 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.726083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:20.876867 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:20.876838    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56879b6cb7-gzz7m"]
Jul 15 16:43:20.879485 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:20.879453    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04fbdd42_e9a9_4a79_b166_b12da2fdd241.slice/crio-f64dfad2bc0520ad0564fe3233eb19ef0d01358dfc692026ed914ea3ae1f0713 WatchSource:0}: Error finding container f64dfad2bc0520ad0564fe3233eb19ef0d01358dfc692026ed914ea3ae1f0713: Status 404 returned error can't find the container with id f64dfad2bc0520ad0564fe3233eb19ef0d01358dfc692026ed914ea3ae1f0713
Jul 15 16:43:21.602147 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:21.602108    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" event={"ID":"04fbdd42-e9a9-4a79-b166-b12da2fdd241","Type":"ContainerStarted","Data":"425ed31af3e08b8c3f8a10376cbad5d45d4acef19eae710f8f0e135eef48386f"}
Jul 15 16:43:21.602570 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:21.602171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" event={"ID":"04fbdd42-e9a9-4a79-b166-b12da2fdd241","Type":"ContainerStarted","Data":"f64dfad2bc0520ad0564fe3233eb19ef0d01358dfc692026ed914ea3ae1f0713"}
Jul 15 16:43:21.602570 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:21.602210    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:43:21.622475 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:21.622423    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podStartSLOduration=1.6224046909999998 podStartE2EDuration="1.622404691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:21.621948326 +0000 UTC m=+188.191823623" watchObservedRunningTime="2026-07-15 16:43:21.622404691 +0000 UTC m=+188.192279996"
Jul 15 16:43:22.966548 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:22.966505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:43:22.969169 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:22.969145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1478d04f-b6e7-4870-ac4a-7341205f1dc8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-td7vf\" (UID: \"1478d04f-b6e7-4870-ac4a-7341205f1dc8\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:43:22.996805 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:22.996769    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c2m2m\""
Jul 15 16:43:23.004838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.004808    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"
Jul 15 16:43:23.067848 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.067783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:23.068467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.068443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b2e7712-5c21-4423-95ab-fd4fc27eb129-service-ca-bundle\") pod \"router-default-7496cb7dcd-n7klc\" (UID: \"4b2e7712-5c21-4423-95ab-fd4fc27eb129\") " pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:23.090629 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.090591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rbvr8\""
Jul 15 16:43:23.098895 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.098862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:23.250666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.250631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf"]
Jul 15 16:43:23.253715 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:23.253685    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1478d04f_b6e7_4870_ac4a_7341205f1dc8.slice/crio-9cd211d575f7ca4e51d95f5657b3ef1f4aa4e84928cbb16584ab908b883c10d7 WatchSource:0}: Error finding container 9cd211d575f7ca4e51d95f5657b3ef1f4aa4e84928cbb16584ab908b883c10d7: Status 404 returned error can't find the container with id 9cd211d575f7ca4e51d95f5657b3ef1f4aa4e84928cbb16584ab908b883c10d7
Jul 15 16:43:23.269416 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.269387    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7496cb7dcd-n7klc"]
Jul 15 16:43:23.271634 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:23.271601    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2e7712_5c21_4423_95ab_fd4fc27eb129.slice/crio-e36b58932c30021d42cf307d2626476b61c9bebf2e23d1be3ac837b0e518d701 WatchSource:0}: Error finding container e36b58932c30021d42cf307d2626476b61c9bebf2e23d1be3ac837b0e518d701: Status 404 returned error can't find the container with id e36b58932c30021d42cf307d2626476b61c9bebf2e23d1be3ac837b0e518d701
Jul 15 16:43:23.614635 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.614592    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6tm" event={"ID":"c3bb2c3c-ee45-482a-b3e9-4766df52e299","Type":"ContainerStarted","Data":"9b6bf677903e27684804cc6a6cca7aabbf54111754fc750385ffc3201a0ad630"}
Jul 15 16:43:23.615906 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.615877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7496cb7dcd-n7klc" event={"ID":"4b2e7712-5c21-4423-95ab-fd4fc27eb129","Type":"ContainerStarted","Data":"f2261c9cbb803f83f9c51d123c8c2fd438d194bd5bbc14b2c8cff4e48d3fdcda"}
Jul 15 16:43:23.616051 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.615920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7496cb7dcd-n7klc" event={"ID":"4b2e7712-5c21-4423-95ab-fd4fc27eb129","Type":"ContainerStarted","Data":"e36b58932c30021d42cf307d2626476b61c9bebf2e23d1be3ac837b0e518d701"}
Jul 15 16:43:23.616888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.616866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf" event={"ID":"1478d04f-b6e7-4870-ac4a-7341205f1dc8","Type":"ContainerStarted","Data":"9cd211d575f7ca4e51d95f5657b3ef1f4aa4e84928cbb16584ab908b883c10d7"}
Jul 15 16:43:23.639441 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:23.639379    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7496cb7dcd-n7klc" podStartSLOduration=32.639359675 podStartE2EDuration="32.639359675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:23.638997145 +0000 UTC m=+190.208872441" watchObservedRunningTime="2026-07-15 16:43:23.639359675 +0000 UTC m=+190.209234972"
Jul 15 16:43:24.100053 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:24.100012    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:24.103209 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:24.103181    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:24.621246 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:24.621212    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:24.622749 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:24.622724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7496cb7dcd-n7klc"
Jul 15 16:43:26.883577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:26.883541    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:26.984590 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:26.984551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:27.085482 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:27.085440    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:27.634135 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:27.634098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qb6tm" event={"ID":"c3bb2c3c-ee45-482a-b3e9-4766df52e299","Type":"ContainerStarted","Data":"28650c7903cdde3cd1d03c897dada1cfdb3e993f657a66ea0ca60e8ccbed0179"}
Jul 15 16:43:27.653449 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:27.653367    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qb6tm" podStartSLOduration=17.243787702 podStartE2EDuration="31.653338038s" totalImagesPullingTime="14.409550336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 16:42:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:27.653148571 +0000 UTC m=+194.223023876" watchObservedRunningTime="2026-07-15 16:43:27.653338038 +0000 UTC m=+194.223213334"
Jul 15 16:43:28.639777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:28.639739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf" event={"ID":"1478d04f-b6e7-4870-ac4a-7341205f1dc8","Type":"ContainerStarted","Data":"efa9955529783ec95ddae41f1fe8e1ab4eb7065d53ee8efe553a97b29d11847c"}
Jul 15 16:43:28.657300 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:28.657247    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-td7vf" podStartSLOduration=32.459369705 podStartE2EDuration="37.657231458s" totalImagesPullingTime="5.197861753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:28.656047012 +0000 UTC m=+195.225922307" watchObservedRunningTime="2026-07-15 16:43:28.657231458 +0000 UTC m=+195.227106793"
Jul 15 16:43:28.762062 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:28.761977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:28.862242 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:28.862202    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:28.933059 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:28.933018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:29.097499 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:29.097464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:30.386652 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:30.386613    2575 patch_prober.go:28] interesting pod/image-registry-6cbd99c7b4-zlgpg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:43:30.387052 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:30.386679    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:43:30.937832 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:30.937779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:31.006256 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:31.006203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:31.079967 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:31.079916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:34.785535 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:34.785496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.055031 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.055000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.157907 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.157876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.278164 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.278123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.332458 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.332425    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dxk5d"]
Jul 15 16:43:36.335565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.335543    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.338316 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.338288    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 16:43:36.338316 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.338304    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 16:43:36.338576 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.338407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zrvq\""
Jul 15 16:43:36.338576 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.338418    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 16:43:36.339543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.339526    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 16:43:36.360239 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.360206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.377106 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-textfile\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377106 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-root\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377308 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmcp\" (UniqueName: \"kubernetes.io/projected/19c0e785-b475-4074-943c-8a4a8f4b41ff-kube-api-access-lnmcp\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377308 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377308 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377424 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19c0e785-b475-4074-943c-8a4a8f4b41ff-metrics-client-ca\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377424 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377424 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-sys\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.377424 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.377413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-wtmp\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.415277 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.415239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.478631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-root\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmcp\" (UniqueName: \"kubernetes.io/projected/19c0e785-b475-4074-943c-8a4a8f4b41ff-kube-api-access-lnmcp\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478714    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-root\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19c0e785-b475-4074-943c-8a4a8f4b41ff-metrics-client-ca\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.478892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-sys\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479188 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:36.478901    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 16:43:36.479188 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:36.478988    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls podName:19c0e785-b475-4074-943c-8a4a8f4b41ff nodeName:}" failed. No retries permitted until 2026-07-15 16:43:36.978966141 +0000 UTC m=+203.548841416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls") pod "node-exporter-dxk5d" (UID: "19c0e785-b475-4074-943c-8a4a8f4b41ff") : secret "node-exporter-tls" not found
Jul 15 16:43:36.479188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.479003    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-sys\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.478893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-wtmp\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.479029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-wtmp\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.479095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-textfile\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479507 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.479330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-textfile\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479507 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.479403    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.479507 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.479461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19c0e785-b475-4074-943c-8a4a8f4b41ff-metrics-client-ca\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.481183 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.481164    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.487569 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.487547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmcp\" (UniqueName: \"kubernetes.io/projected/19c0e785-b475-4074-943c-8a4a8f4b41ff-kube-api-access-lnmcp\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.692331 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.692213    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.777554 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.777522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.906452 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.906417    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-8z7qk"]
Jul 15 16:43:36.909594 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.909577    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:36.912325 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.912302    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 16:43:36.912451 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.912302    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 16:43:36.912451 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.912348    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-47ctd\""
Jul 15 16:43:36.919475 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.919453    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-8z7qk"]
Jul 15 16:43:36.922401 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.922377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:36.983867 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.983744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:36.983867 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:36.983816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj5h5\" (UniqueName: \"kubernetes.io/projected/981edb29-0c6a-4e3c-a2c0-f1c3dd60a986-kube-api-access-zj5h5\") pod \"downloads-68c9cbb497-8z7qk\" (UID: \"981edb29-0c6a-4e3c-a2c0-f1c3dd60a986\") " pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:36.984082 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:36.983901    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 16:43:36.984082 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:36.983978    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls podName:19c0e785-b475-4074-943c-8a4a8f4b41ff nodeName:}" failed. No retries permitted until 2026-07-15 16:43:37.983960279 +0000 UTC m=+204.553835552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls") pod "node-exporter-dxk5d" (UID: "19c0e785-b475-4074-943c-8a4a8f4b41ff") : secret "node-exporter-tls" not found
Jul 15 16:43:37.022506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.022460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.084407 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.084375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj5h5\" (UniqueName: \"kubernetes.io/projected/981edb29-0c6a-4e3c-a2c0-f1c3dd60a986-kube-api-access-zj5h5\") pod \"downloads-68c9cbb497-8z7qk\" (UID: \"981edb29-0c6a-4e3c-a2c0-f1c3dd60a986\") " pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:37.093540 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.093513    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj5h5\" (UniqueName: \"kubernetes.io/projected/981edb29-0c6a-4e3c-a2c0-f1c3dd60a986-kube-api-access-zj5h5\") pod \"downloads-68c9cbb497-8z7qk\" (UID: \"981edb29-0c6a-4e3c-a2c0-f1c3dd60a986\") " pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:37.125294 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.125263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.219426 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.219389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:37.223510 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.223481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.325431 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.325397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.354428 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.354386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-8z7qk"]
Jul 15 16:43:37.357819 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:37.357771    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981edb29_0c6a_4e3c_a2c0_f1c3dd60a986.slice/crio-55220be0688bef2ed10496da84541d8172daec112e0699467b2fcc7bd0a1fac5 WatchSource:0}: Error finding container 55220be0688bef2ed10496da84541d8172daec112e0699467b2fcc7bd0a1fac5: Status 404 returned error can't find the container with id 55220be0688bef2ed10496da84541d8172daec112e0699467b2fcc7bd0a1fac5
Jul 15 16:43:37.405734 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.405701    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.524727 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.524630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.668977 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.668938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-8z7qk" event={"ID":"981edb29-0c6a-4e3c-a2c0-f1c3dd60a986","Type":"ContainerStarted","Data":"55220be0688bef2ed10496da84541d8172daec112e0699467b2fcc7bd0a1fac5"}
Jul 15 16:43:37.762964 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.762929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.836266 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.836231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.965527 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.965495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:37.993354 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.993303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:37.996229 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:37.996200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c0e785-b475-4074-943c-8a4a8f4b41ff-node-exporter-tls\") pod \"node-exporter-dxk5d\" (UID: \"19c0e785-b475-4074-943c-8a4a8f4b41ff\") " pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:38.026342 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:38.026301    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:38.145552 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:38.145456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dxk5d"
Jul 15 16:43:38.155939 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:38.155910    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c0e785_b475_4074_943c_8a4a8f4b41ff.slice/crio-c4fecdce02396346930707633eded98e9dc7ab0fc9ba408058f6f4609fc3d131 WatchSource:0}: Error finding container c4fecdce02396346930707633eded98e9dc7ab0fc9ba408058f6f4609fc3d131: Status 404 returned error can't find the container with id c4fecdce02396346930707633eded98e9dc7ab0fc9ba408058f6f4609fc3d131
Jul 15 16:43:38.592280 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:38.592231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:38.676771 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:38.676727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxk5d" event={"ID":"19c0e785-b475-4074-943c-8a4a8f4b41ff","Type":"ContainerStarted","Data":"c4fecdce02396346930707633eded98e9dc7ab0fc9ba408058f6f4609fc3d131"}
Jul 15 16:43:38.793314 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:38.793272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:39.094384 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.094350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:39.217992 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.217950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:39.288409 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.288378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:39.293100 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.293070    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"]
Jul 15 16:43:39.296983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.296961    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.299949 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.299923    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 16:43:39.300094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.299951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 16:43:39.300094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.299963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 16:43:39.300094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.299983    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6rdn9\""
Jul 15 16:43:39.300094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.300059    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 16:43:39.300277 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.300249    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 16:43:39.300333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.300278    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6f62a9stu133n\""
Jul 15 16:43:39.308783 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.308760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"]
Jul 15 16:43:39.408750 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.408675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.408750 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.408719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.409001 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.408813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-tls\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.409001 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.408894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/775ac289-ef16-44fa-8bab-e9402502c70b-metrics-client-ca\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.409001 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.408973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.409110 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.409006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-grpc-tls\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.409110 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.409055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.409110 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.409082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7k5q\" (UniqueName: \"kubernetes.io/projected/775ac289-ef16-44fa-8bab-e9402502c70b-kube-api-access-d7k5q\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510132 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-tls\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/775ac289-ef16-44fa-8bab-e9402502c70b-metrics-client-ca\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-grpc-tls\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510467 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510575 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7k5q\" (UniqueName: \"kubernetes.io/projected/775ac289-ef16-44fa-8bab-e9402502c70b-kube-api-access-d7k5q\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510575 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.510575 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.510565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.511098 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.511037    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/775ac289-ef16-44fa-8bab-e9402502c70b-metrics-client-ca\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.513631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.513574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-tls\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.513782 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.513752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.514234 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.514210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.514333 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.514259    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.514423 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.514398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.514525 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.514428    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/775ac289-ef16-44fa-8bab-e9402502c70b-secret-grpc-tls\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.518971 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.518945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7k5q\" (UniqueName: \"kubernetes.io/projected/775ac289-ef16-44fa-8bab-e9402502c70b-kube-api-access-d7k5q\") pod \"thanos-querier-76d5f65f5b-nv2z8\" (UID: \"775ac289-ef16-44fa-8bab-e9402502c70b\") " pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.600689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.600625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:39.608614 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.608582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:39.757976 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.757941    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"]
Jul 15 16:43:39.761148 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:39.761117    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775ac289_ef16_44fa_8bab_e9402502c70b.slice/crio-be05a070065a665d20e709e6a1c6eed8e4fd054aa656ce72dcc16826886e1242 WatchSource:0}: Error finding container be05a070065a665d20e709e6a1c6eed8e4fd054aa656ce72dcc16826886e1242: Status 404 returned error can't find the container with id be05a070065a665d20e709e6a1c6eed8e4fd054aa656ce72dcc16826886e1242
Jul 15 16:43:39.766906 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.766879    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:39.914399 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:39.914365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:40.387832 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.387769    2575 patch_prober.go:28] interesting pod/image-registry-6cbd99c7b4-zlgpg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:43:40.388314 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.387876    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:43:40.690942 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.690842    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"be05a070065a665d20e709e6a1c6eed8e4fd054aa656ce72dcc16826886e1242"}
Jul 15 16:43:40.719348 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.719306    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f76779f4d-w2z7c"]
Jul 15 16:43:40.722806 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.722763    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.726564 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.726539    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zt86m\""
Jul 15 16:43:40.726720 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.726662    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 16:43:40.726720 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.726662    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 16:43:40.726873 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.726716    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 16:43:40.727311 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.727012    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 16:43:40.727311 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.727119    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-54566e6fl076u\""
Jul 15 16:43:40.731710 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.731685    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f76779f4d-w2z7c"]
Jul 15 16:43:40.733979 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.733955    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:43:40.734087 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.734005    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:43:40.821030 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.820992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f3b8000-a714-49ee-916a-3de0ff6e8257-metrics-server-audit-profiles\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.821212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.821059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-client-ca-bundle\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.821212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.821131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-secret-metrics-server-tls\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.821356 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.821207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f3b8000-a714-49ee-916a-3de0ff6e8257-audit-log\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.821356 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.821245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-487rm\" (UniqueName: \"kubernetes.io/projected/3f3b8000-a714-49ee-916a-3de0ff6e8257-kube-api-access-487rm\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.821356 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.821314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-secret-metrics-server-client-certs\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.821504 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.821363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3b8000-a714-49ee-916a-3de0ff6e8257-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.922654 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-secret-metrics-server-tls\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.922888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f3b8000-a714-49ee-916a-3de0ff6e8257-audit-log\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.922888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-487rm\" (UniqueName: \"kubernetes.io/projected/3f3b8000-a714-49ee-916a-3de0ff6e8257-kube-api-access-487rm\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.922888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922761    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-secret-metrics-server-client-certs\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.922888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3b8000-a714-49ee-916a-3de0ff6e8257-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.922888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f3b8000-a714-49ee-916a-3de0ff6e8257-metrics-server-audit-profiles\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.923140 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.922923    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-client-ca-bundle\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.924115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.923946    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3f3b8000-a714-49ee-916a-3de0ff6e8257-audit-log\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.924440 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.924416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f3b8000-a714-49ee-916a-3de0ff6e8257-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.924538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.924513    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3f3b8000-a714-49ee-916a-3de0ff6e8257-metrics-server-audit-profiles\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.926376 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.926350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-secret-metrics-server-tls\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.926630 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.926586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-client-ca-bundle\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.926865 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.926833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3f3b8000-a714-49ee-916a-3de0ff6e8257-secret-metrics-server-client-certs\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:40.931686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:40.931661    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-487rm\" (UniqueName: \"kubernetes.io/projected/3f3b8000-a714-49ee-916a-3de0ff6e8257-kube-api-access-487rm\") pod \"metrics-server-5f76779f4d-w2z7c\" (UID: \"3f3b8000-a714-49ee-916a-3de0ff6e8257\") " pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:41.038602 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:41.038383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:43:41.080309 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:41.080271    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:41.136744 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:41.136706    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:41.388019 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:41.387982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:41.740190 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:41.740161    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f76779f4d-w2z7c"]
Jul 15 16:43:41.745116 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:41.745085    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3b8000_a714_49ee_916a_3de0ff6e8257.slice/crio-e00843de65c35424e53f471169b52301ce187d651c142687d9c6f53c86a0ee67 WatchSource:0}: Error finding container e00843de65c35424e53f471169b52301ce187d651c142687d9c6f53c86a0ee67: Status 404 returned error can't find the container with id e00843de65c35424e53f471169b52301ce187d651c142687d9c6f53c86a0ee67
Jul 15 16:43:42.474643 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.474601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:42.479498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.479460    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:43:42.483740 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.483698    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.486340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.486310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 16:43:42.486340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.486332    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 16:43:42.486613 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.486596    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 16:43:42.486814 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.486781    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 16:43:42.486887 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.486834    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 16:43:42.487043 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.487027    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 16:43:42.487102 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.487079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8jo966adff0ct\""
Jul 15 16:43:42.487232 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.487215    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 16:43:42.487291 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.487263    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 16:43:42.487743 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.487478    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 16:43:42.488757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.488090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 16:43:42.488757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.488109    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 16:43:42.488757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.488130    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ld8xt\""
Jul 15 16:43:42.488757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.488286    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 16:43:42.488757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.488520    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 16:43:42.490725 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.490699    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 16:43:42.497477 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.497373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-config\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.538999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpc6x\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-kube-api-access-qpc6x\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.539622 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.540372 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.539346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.617491 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.617448    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:43:42.617689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.617541    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:43:42.640242 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-config\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.640819 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.640729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.641804 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.641766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.641895 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.641770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.642298 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.642268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpc6x\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-kube-api-access-qpc6x\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.644474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.644451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.644665 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.642584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.644737 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.642748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.644861 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.644645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.648650 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.648629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.648873 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.643011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.648873 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.645597    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.648873 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.647340    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.648873 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.647672    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.648873 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.642490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.652908 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.652486    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.652908 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.652541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.652908 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.652607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.652908 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.652718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.652908 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.652770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.653231 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.652922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.653231 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.653013    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-config\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.653231 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.653045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.654230 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.654171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.657838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.657777    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.664828 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.664778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpc6x\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-kube-api-access-qpc6x\") pod \"prometheus-k8s-0\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:42.705303 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.705255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"e176ae39c588d916f7799700086cd6b9b76b45287453dabc279d312260d53090"}
Jul 15 16:43:42.705496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.705367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"163b49b46424556ac153181dcdbb196ef4d043c5bccb1b0ec207783de6ee988d"}
Jul 15 16:43:42.705496 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.705411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"e654ab3aa60d198f9c318434d960782b35f115512d72b4bc72747565f50409e5"}
Jul 15 16:43:42.706967 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.706892    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c" event={"ID":"3f3b8000-a714-49ee-916a-3de0ff6e8257","Type":"ContainerStarted","Data":"e00843de65c35424e53f471169b52301ce187d651c142687d9c6f53c86a0ee67"}
Jul 15 16:43:42.709461 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.709429    2575 generic.go:356] "Generic (PLEG): container finished" podID="19c0e785-b475-4074-943c-8a4a8f4b41ff" containerID="6abc6eb8086d8613acf9fd45a0209795ebc8e20e5580c53828dc6a890600f80d" exitCode=0
Jul 15 16:43:42.709589 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.709514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxk5d" event={"ID":"19c0e785-b475-4074-943c-8a4a8f4b41ff","Type":"ContainerDied","Data":"6abc6eb8086d8613acf9fd45a0209795ebc8e20e5580c53828dc6a890600f80d"}
Jul 15 16:43:42.797154 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:42.796997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:43:43.010129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.010104    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:43:43.355330 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:43:43.355295    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc33de62f_c204_4352_8367_6f5bac31856b.slice/crio-228d387abeb97d786e4d07f04e71e505e888b10fc036e5f787790432c8f0daf4 WatchSource:0}: Error finding container 228d387abeb97d786e4d07f04e71e505e888b10fc036e5f787790432c8f0daf4: Status 404 returned error can't find the container with id 228d387abeb97d786e4d07f04e71e505e888b10fc036e5f787790432c8f0daf4
Jul 15 16:43:43.717999 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.717955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"80b7b08849c5c34be31c21c33ad0e2c3dc477bab5095d613b53ad421cca859d0"}
Jul 15 16:43:43.718488 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.718033    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"580f92bf25e4641067efe36c46d950f6f1b91cc74ab52f114c6a0b9ef9a27892"}
Jul 15 16:43:43.718488 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.718072    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" event={"ID":"775ac289-ef16-44fa-8bab-e9402502c70b","Type":"ContainerStarted","Data":"31e995fe725f40e3eb4f69d5d0319cb44e5e489643c34da86d58574f3157ba97"}
Jul 15 16:43:43.718488 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.718160    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:43.720484 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.720451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c" event={"ID":"3f3b8000-a714-49ee-916a-3de0ff6e8257","Type":"ContainerStarted","Data":"f29c71df10f497781715f6702798f70bcccd39c86178db226661f37af13a8be5"}
Jul 15 16:43:43.723504 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.723476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxk5d" event={"ID":"19c0e785-b475-4074-943c-8a4a8f4b41ff","Type":"ContainerStarted","Data":"d8abc345378d1e95f9f140a78a0f9b98445b12f7d27cf842336a3a99d9cfa42f"}
Jul 15 16:43:43.723638 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.723527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dxk5d" event={"ID":"19c0e785-b475-4074-943c-8a4a8f4b41ff","Type":"ContainerStarted","Data":"6cd8ff4f6f41f0b0365ae09c7e4f06578d6931390ec01b6bb82708282b25f3a3"}
Jul 15 16:43:43.725182 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.725154    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"228d387abeb97d786e4d07f04e71e505e888b10fc036e5f787790432c8f0daf4"}
Jul 15 16:43:43.744931 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.744867    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8" podStartSLOduration=1.41157395 podStartE2EDuration="4.744844801s" totalImagesPullingTime="3.333270851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:43.743297662 +0000 UTC m=+210.313172959" watchObservedRunningTime="2026-07-15 16:43:43.744844801 +0000 UTC m=+210.314720096"
Jul 15 16:43:43.764020 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.763956    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dxk5d" podStartSLOduration=3.578451763 podStartE2EDuration="7.76393332s" totalImagesPullingTime="4.100264334s" totalInitContainerRuntime="85.217223ms" isStatefulPod=true podCreationTimestamp="2026-07-15 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:43.762409715 +0000 UTC m=+210.332285012" watchObservedRunningTime="2026-07-15 16:43:43.76393332 +0000 UTC m=+210.333808617"
Jul 15 16:43:43.782513 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:43.782446    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c" podStartSLOduration=2.120886111 podStartE2EDuration="3.78242267s" totalImagesPullingTime="1.661536559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:43.781691307 +0000 UTC m=+210.351566605" watchObservedRunningTime="2026-07-15 16:43:43.78242267 +0000 UTC m=+210.352297969"
Jul 15 16:43:44.730867 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:44.730755    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="3fd1df1662d7862a37bbd6a60128e823cebd183c832179c8458e4c10e4054098" exitCode=0
Jul 15 16:43:44.730867 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:44.730843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"3fd1df1662d7862a37bbd6a60128e823cebd183c832179c8458e4c10e4054098"}
Jul 15 16:43:45.411498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.411451    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerName="registry" containerID="cri-o://1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf" gracePeriod=30
Jul 15 16:43:45.679337 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.679309    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:43:45.736185 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.736139    2575 generic.go:356] "Generic (PLEG): container finished" podID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerID="1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf" exitCode=0
Jul 15 16:43:45.736624 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.736214    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"
Jul 15 16:43:45.736624 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.736215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" event={"ID":"e069128c-71f4-436b-b9e1-ba356fdf1429","Type":"ContainerDied","Data":"1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf"}
Jul 15 16:43:45.736624 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.736287    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbd99c7b4-zlgpg" event={"ID":"e069128c-71f4-436b-b9e1-ba356fdf1429","Type":"ContainerDied","Data":"10f5e958c0caf9da2cc6464ee4325f63e1fe33d4e0b53df6ecb58225b3124a9e"}
Jul 15 16:43:45.736624 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.736309    2575 scope.go:117] "RemoveContainer" containerID="1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf"
Jul 15 16:43:45.748763 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.748741    2575 scope.go:117] "RemoveContainer" containerID="1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf"
Jul 15 16:43:45.749191 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:43:45.749159    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf\": container with ID starting with 1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf not found: ID does not exist" containerID="1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf"
Jul 15 16:43:45.749296 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.749205    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf"} err="failed to get container status \"1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf\": rpc error: code = NotFound desc = could not find container \"1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf\": container with ID starting with 1904eea26b41178f44f4ac3db8f2fb38883e31125689f71c6c1794a28aabacdf not found: ID does not exist"
Jul 15 16:43:45.780704 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780669    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-certificates\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.780901 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780714    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-installation-pull-secrets\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.780901 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780759    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e069128c-71f4-436b-b9e1-ba356fdf1429-ca-trust-extracted\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.780901 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn2k6\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-kube-api-access-mn2k6\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.781075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-image-registry-private-configuration\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.781075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780933    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.781075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.780985    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-trusted-ca\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.781216 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.781173    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-bound-sa-token\") pod \"e069128c-71f4-436b-b9e1-ba356fdf1429\" (UID: \"e069128c-71f4-436b-b9e1-ba356fdf1429\") "
Jul 15 16:43:45.781216 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.781173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:43:45.781506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.781467    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:43:45.781805 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.781716    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-certificates\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.781805 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.781746    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e069128c-71f4-436b-b9e1-ba356fdf1429-trusted-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.783631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.783583    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:43:45.783732 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.783699    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:43:45.783912 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.783871    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:43:45.784206 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.784058    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-kube-api-access-mn2k6" (OuterVolumeSpecName: "kube-api-access-mn2k6") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "kube-api-access-mn2k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:43:45.784284 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.784264    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:43:45.792631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.792596    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e069128c-71f4-436b-b9e1-ba356fdf1429-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e069128c-71f4-436b-b9e1-ba356fdf1429" (UID: "e069128c-71f4-436b-b9e1-ba356fdf1429"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:43:45.883149 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.883109    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-bound-sa-token\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.883149 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.883142    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-installation-pull-secrets\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.883149 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.883154    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e069128c-71f4-436b-b9e1-ba356fdf1429-ca-trust-extracted\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.883445 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.883162    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn2k6\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-kube-api-access-mn2k6\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.883445 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.883172    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e069128c-71f4-436b-b9e1-ba356fdf1429-image-registry-private-configuration\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:45.883445 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:45.883186    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e069128c-71f4-436b-b9e1-ba356fdf1429-registry-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:43:46.053044 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:46.053003    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"]
Jul 15 16:43:46.058345 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:46.058309    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cbd99c7b4-zlgpg"]
Jul 15 16:43:48.025287 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:48.025151    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" path="/var/lib/kubelet/pods/e069128c-71f4-436b-b9e1-ba356fdf1429/volumes"
Jul 15 16:43:48.210463 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:48.210422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:48.279236 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:48.279113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:49.738503 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:49.738476    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-76d5f65f5b-nv2z8"
Jul 15 16:43:50.731460 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:50.731411    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:43:50.731647 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:50.731475    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:43:51.812485 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:51.812389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:51.912211 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:51.912175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:52.611142 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:52.611087    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:43:52.611339 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:52.611160    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:43:54.122450 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:54.122422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:54.179738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:54.179696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:56.207028 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.206933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:56.308827 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.308803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:43:56.785912 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.785867    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-8z7qk" event={"ID":"981edb29-0c6a-4e3c-a2c0-f1c3dd60a986","Type":"ContainerStarted","Data":"7cfbb89b5d2a5ad8b22d2eaa5e507638a24d097a510dddce40769fee47c04651"}
Jul 15 16:43:56.786133 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.786106    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:56.790176 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.790148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"e122689c69381271fb762db6f9e6710f298e560a4cb80a43cbde7d01dcae0147"}
Jul 15 16:43:56.790313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.790218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"c3b6f5ccf0e2c57f7268dfbd5bd348eba6d9f9a8981971f1e324f0f174b5e413"}
Jul 15 16:43:56.790313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.790250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"41ce409e40bab456002d1e12dc6c1e63605f9b934ddf4fdbd949740863edd64b"}
Jul 15 16:43:56.790313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.790279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"4ec2588a2191b2411d25b3175a31a9a62c9f2c8d363eea2ea558b98e0ce38749"}
Jul 15 16:43:56.790313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.790308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"5a29230b6667c5cc3eaa03bd92770328a0ea4942c56dbda5a8407aea2f9eb0a4"}
Jul 15 16:43:56.790522 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.790348    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerStarted","Data":"dc1c168ed8270f6201b3c7834d2b9ced27a847dad1ab373a01bbdbae29689de9"}
Jul 15 16:43:56.805450 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.805385    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-8z7qk" podStartSLOduration=2.181348288 podStartE2EDuration="20.805363809s" totalImagesPullingTime="18.624015521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:56.802857656 +0000 UTC m=+223.372732952" watchObservedRunningTime="2026-07-15 16:43:56.805363809 +0000 UTC m=+223.375239106"
Jul 15 16:43:56.805639 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.805472    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-8z7qk"
Jul 15 16:43:56.836548 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:56.836485    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.545634996 podStartE2EDuration="14.836459343s" totalImagesPullingTime="12.269022496s" totalInitContainerRuntime="21.801851ms" isStatefulPod=false podCreationTimestamp="2026-07-15 16:43:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:43:56.834637549 +0000 UTC m=+223.404512870" watchObservedRunningTime="2026-07-15 16:43:56.836459343 +0000 UTC m=+223.406334642"
Jul 15 16:43:57.798063 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:43:57.798033    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:44:00.731815 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:00.731755    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:00.732392 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:00.731835    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:00.732392 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:00.731886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:44:00.732546 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:00.732519    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"425ed31af3e08b8c3f8a10376cbad5d45d4acef19eae710f8f0e135eef48386f"} pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 15 16:44:00.737194 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:00.737163    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:00.737389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:00.737207    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:01.039449 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:01.039354    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:44:01.039449 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:01.039434    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:44:09.651207 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:09.651167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:09.711541 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:09.711510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:10.737160 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:10.737125    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:10.737553 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:10.737183    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:18.173708 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:18.173672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:18.232715 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:18.232678    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:19.454706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:19.454659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:20.538542 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:20.538509    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:20.603679 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:20.603647    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:20.736979 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:20.736947    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:20.737151 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:20.737008    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:21.044954 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:21.044919    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:44:21.050150 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:21.050120    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f76779f4d-w2z7c"
Jul 15 16:44:24.902199 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:24.902162    2575 generic.go:356] "Generic (PLEG): container finished" podID="4c3e7bf8-1b18-474c-a724-977437d34227" containerID="6e578982c5aafb02ad8dff737750a7104ff12bea91e9fdfd44f5b0449e3cda79" exitCode=0
Jul 15 16:44:24.902690 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:24.902239    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9" event={"ID":"4c3e7bf8-1b18-474c-a724-977437d34227","Type":"ContainerDied","Data":"6e578982c5aafb02ad8dff737750a7104ff12bea91e9fdfd44f5b0449e3cda79"}
Jul 15 16:44:24.902690 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:24.902673    2575 scope.go:117] "RemoveContainer" containerID="6e578982c5aafb02ad8dff737750a7104ff12bea91e9fdfd44f5b0449e3cda79"
Jul 15 16:44:25.507637 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:25.507599    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-td7vf_1478d04f-b6e7-4870-ac4a-7341205f1dc8/cluster-monitoring-operator/0.log"
Jul 15 16:44:25.756538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:25.756490    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" containerID="cri-o://425ed31af3e08b8c3f8a10376cbad5d45d4acef19eae710f8f0e135eef48386f" gracePeriod=30
Jul 15 16:44:25.867741 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:25.867697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:44:25.870168 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:25.870145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38-metrics-certs\") pod \"network-metrics-daemon-dg7fn\" (UID: \"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38\") " pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:44:25.907709 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:25.907676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-nr4z9" event={"ID":"4c3e7bf8-1b18-474c-a724-977437d34227","Type":"ContainerStarted","Data":"5fe8641536a6aef9e6fe2e8132ccd1e64c9860b9182b2a3cc8c054aadebf1408"}
Jul 15 16:44:26.121251 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.121164    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5p9xs\""
Jul 15 16:44:26.129155 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.129132    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dg7fn"
Jul 15 16:44:26.276173 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.276141    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dg7fn"]
Jul 15 16:44:26.279122 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:44:26.279093    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d646b72_a7fa_47fc_ba1c_f3cb08d7bd38.slice/crio-4f3181a0159e02682da4eddb2a710e278d7bc911e924c86d59fd345386044884 WatchSource:0}: Error finding container 4f3181a0159e02682da4eddb2a710e278d7bc911e924c86d59fd345386044884: Status 404 returned error can't find the container with id 4f3181a0159e02682da4eddb2a710e278d7bc911e924c86d59fd345386044884
Jul 15 16:44:26.318404 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.318301    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f76779f4d-w2z7c_3f3b8000-a714-49ee-916a-3de0ff6e8257/metrics-server/0.log"
Jul 15 16:44:26.706173 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.706145    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxk5d_19c0e785-b475-4074-943c-8a4a8f4b41ff/init-textfile/0.log"
Jul 15 16:44:26.906534 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.906492    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxk5d_19c0e785-b475-4074-943c-8a4a8f4b41ff/node-exporter/0.log"
Jul 15 16:44:26.915300 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.915265    2575 generic.go:356] "Generic (PLEG): container finished" podID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerID="425ed31af3e08b8c3f8a10376cbad5d45d4acef19eae710f8f0e135eef48386f" exitCode=0
Jul 15 16:44:26.915743 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.915356    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" event={"ID":"04fbdd42-e9a9-4a79-b166-b12da2fdd241","Type":"ContainerDied","Data":"425ed31af3e08b8c3f8a10376cbad5d45d4acef19eae710f8f0e135eef48386f"}
Jul 15 16:44:26.916696 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:26.916670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dg7fn" event={"ID":"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38","Type":"ContainerStarted","Data":"4f3181a0159e02682da4eddb2a710e278d7bc911e924c86d59fd345386044884"}
Jul 15 16:44:27.105543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:27.105513    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxk5d_19c0e785-b475-4074-943c-8a4a8f4b41ff/kube-rbac-proxy/0.log"
Jul 15 16:44:27.921553 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:27.921521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" event={"ID":"04fbdd42-e9a9-4a79-b166-b12da2fdd241","Type":"ContainerStarted","Data":"09c7e86f0e34966275a78e063e248b9fd532f70ff66e8d5db74c6975ce893fd4"}
Jul 15 16:44:27.922011 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:27.921622    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:44:28.750141 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:28.750112    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:28.927780 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:28.927739    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dg7fn" event={"ID":"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38","Type":"ContainerStarted","Data":"b2ed4d03e01f0a21f688f150ded3841ec207b4d5619ce56be0fca6ba662b36df"}
Jul 15 16:44:28.928215 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:28.927828    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dg7fn" event={"ID":"0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38","Type":"ContainerStarted","Data":"ef149e6ec0bc285db716d260e60a90f9fa4daab962f11d18b735a60c3c8acd4b"}
Jul 15 16:44:28.945001 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:28.944946    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dg7fn" podStartSLOduration=253.404603495 podStartE2EDuration="4m14.944928826s" totalImagesPullingTime="1.540325331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:44:28.944277456 +0000 UTC m=+255.514152766" watchObservedRunningTime="2026-07-15 16:44:28.944928826 +0000 UTC m=+255.514804163"
Jul 15 16:44:29.041134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.041046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:29.093912 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.093876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:29.105167 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.105112    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/init-config-reloader/0.log"
Jul 15 16:44:29.145925 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.145892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:29.306294 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.306214    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/prometheus/0.log"
Jul 15 16:44:29.506330 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.506301    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/config-reloader/0.log"
Jul 15 16:44:29.706115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.706092    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/thanos-sidecar/0.log"
Jul 15 16:44:29.905642 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:29.905589    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/kube-rbac-proxy-web/0.log"
Jul 15 16:44:30.106280 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:30.106257    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/kube-rbac-proxy/0.log"
Jul 15 16:44:30.306541 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:30.306515    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c33de62f-c204-4352-8367-6f5bac31856b/kube-rbac-proxy-thanos/0.log"
Jul 15 16:44:31.104893 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.104854    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/thanos-query/0.log"
Jul 15 16:44:31.167870 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.167839    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:31.222778 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.222743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:31.305840 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.305809    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy-web/0.log"
Jul 15 16:44:31.506138 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.506061    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy/0.log"
Jul 15 16:44:31.705892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.705863    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/prom-label-proxy/0.log"
Jul 15 16:44:31.905942 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:31.905916    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy-rules/0.log"
Jul 15 16:44:32.105615 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:32.105589    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy-metrics/0.log"
Jul 15 16:44:33.306429 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:33.306396    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-8z7qk_981edb29-0c6a-4e3c-a2c0-f1c3dd60a986/download-server/0.log"
Jul 15 16:44:35.106177 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:35.106146    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smvl6_ecb014ab-7df6-43ff-b6df-5164e09bde95/dns-node-resolver/0.log"
Jul 15 16:44:35.306094 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:35.306017    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56879b6cb7-gzz7m_04fbdd42-e9a9-4a79-b166-b12da2fdd241/registry/1.log"
Jul 15 16:44:35.905081 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:35.905056    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlk9h_9b36c47c-a728-453c-94f3-c2e732977410/node-ca/0.log"
Jul 15 16:44:36.305988 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:36.305912    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7496cb7dcd-n7klc_4b2e7712-5c21-4423-95ab-fd4fc27eb129/router/0.log"
Jul 15 16:44:36.506082 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:36.506053    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xvnw_c00c3351-8a70-459d-a6ea-e7ff30898a78/serve-healthcheck-canary/0.log"
Jul 15 16:44:38.177574 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:38.177539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:38.278629 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:38.278595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:40.732047 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:40.732004    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:40.732425 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:40.732061    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:42.797406 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:42.797361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:44:42.813703 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:42.813676    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:44:43.005133 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:43.005106    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:44:47.854485 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:47.854444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:47.905571 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:47.905531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:48.932177 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:48.932139    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:48.932563 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:48.932206    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:50.730392 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:50.730353    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:50.730893 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:50.730410    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:55.492737 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:55.492698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:55.511072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:44:55.511026    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cszs7" podUID="894d176c-ac2c-4562-82df-3c58378aa6eb"
Jul 15 16:44:55.826725 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:55.826689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:56.035247 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:56.035218    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cszs7"
Jul 15 16:44:57.377578 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:57.377536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:57.439422 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:57.439385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:44:58.932606 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:58.932567    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:44:58.933021 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:58.932631    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:44:59.272131 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:59.272034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:44:59.274447 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:59.274417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/894d176c-ac2c-4562-82df-3c58378aa6eb-metrics-tls\") pod \"dns-default-cszs7\" (UID: \"894d176c-ac2c-4562-82df-3c58378aa6eb\") " pod="openshift-dns/dns-default-cszs7"
Jul 15 16:44:59.339098 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:59.339062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6gzkx\""
Jul 15 16:44:59.346368 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:59.346340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cszs7"
Jul 15 16:44:59.481986 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:44:59.481950    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cszs7"]
Jul 15 16:44:59.485367 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:44:59.485338    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894d176c_ac2c_4562_82df_3c58378aa6eb.slice/crio-8b237fbefce73c7f5f8e6fde9169e6d2a2234f141be055a819b89ad9e27c75a2 WatchSource:0}: Error finding container 8b237fbefce73c7f5f8e6fde9169e6d2a2234f141be055a819b89ad9e27c75a2: Status 404 returned error can't find the container with id 8b237fbefce73c7f5f8e6fde9169e6d2a2234f141be055a819b89ad9e27c75a2
Jul 15 16:45:00.050968 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.050922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cszs7" event={"ID":"894d176c-ac2c-4562-82df-3c58378aa6eb","Type":"ContainerStarted","Data":"8b237fbefce73c7f5f8e6fde9169e6d2a2234f141be055a819b89ad9e27c75a2"}
Jul 15 16:45:00.730626 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.730590    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:45:00.730838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.730658    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:45:00.730838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.730713    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:45:00.731361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.731335    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"09c7e86f0e34966275a78e063e248b9fd532f70ff66e8d5db74c6975ce893fd4"} pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 15 16:45:00.735602 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.735572    2575 patch_prober.go:28] interesting pod/image-registry-56879b6cb7-gzz7m container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 16:45:00.735716 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.735634    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 16:45:00.879359 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879323    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:45:00.879930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879693    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-web" containerID="cri-o://41ce409e40bab456002d1e12dc6c1e63605f9b934ddf4fdbd949740863edd64b" gracePeriod=600
Jul 15 16:45:00.879930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879693    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e122689c69381271fb762db6f9e6710f298e560a4cb80a43cbde7d01dcae0147" gracePeriod=600
Jul 15 16:45:00.879930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879762    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy" containerID="cri-o://c3b6f5ccf0e2c57f7268dfbd5bd348eba6d9f9a8981971f1e324f0f174b5e413" gracePeriod=600
Jul 15 16:45:00.879930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879741    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="config-reloader" containerID="cri-o://5a29230b6667c5cc3eaa03bd92770328a0ea4942c56dbda5a8407aea2f9eb0a4" gracePeriod=600
Jul 15 16:45:00.879930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879690    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="prometheus" containerID="cri-o://dc1c168ed8270f6201b3c7834d2b9ced27a847dad1ab373a01bbdbae29689de9" gracePeriod=600
Jul 15 16:45:00.879930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:00.879742    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="thanos-sidecar" containerID="cri-o://4ec2588a2191b2411d25b3175a31a9a62c9f2c8d363eea2ea558b98e0ce38749" gracePeriod=600
Jul 15 16:45:01.061099 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061059    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="e122689c69381271fb762db6f9e6710f298e560a4cb80a43cbde7d01dcae0147" exitCode=0
Jul 15 16:45:01.061099 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061094    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="c3b6f5ccf0e2c57f7268dfbd5bd348eba6d9f9a8981971f1e324f0f174b5e413" exitCode=0
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061108    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="41ce409e40bab456002d1e12dc6c1e63605f9b934ddf4fdbd949740863edd64b" exitCode=0
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061118    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="4ec2588a2191b2411d25b3175a31a9a62c9f2c8d363eea2ea558b98e0ce38749" exitCode=0
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061128    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="5a29230b6667c5cc3eaa03bd92770328a0ea4942c56dbda5a8407aea2f9eb0a4" exitCode=0
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061136    2575 generic.go:356] "Generic (PLEG): container finished" podID="c33de62f-c204-4352-8367-6f5bac31856b" containerID="dc1c168ed8270f6201b3c7834d2b9ced27a847dad1ab373a01bbdbae29689de9" exitCode=0
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061236    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"e122689c69381271fb762db6f9e6710f298e560a4cb80a43cbde7d01dcae0147"}
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"c3b6f5ccf0e2c57f7268dfbd5bd348eba6d9f9a8981971f1e324f0f174b5e413"}
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"41ce409e40bab456002d1e12dc6c1e63605f9b934ddf4fdbd949740863edd64b"}
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061394    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"4ec2588a2191b2411d25b3175a31a9a62c9f2c8d363eea2ea558b98e0ce38749"}
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"5a29230b6667c5cc3eaa03bd92770328a0ea4942c56dbda5a8407aea2f9eb0a4"}
Jul 15 16:45:01.061686 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.061495    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"dc1c168ed8270f6201b3c7834d2b9ced27a847dad1ab373a01bbdbae29689de9"}
Jul 15 16:45:01.163681 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.163602    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:01.288100 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288002    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpc6x\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-kube-api-access-qpc6x\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288100 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288049    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-2\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288100 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288069    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-kubelet-serving-ca-bundle\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288100 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288101    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-web-config\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-grpc-tls\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-config\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-metrics-client-certs\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288502 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288433    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-tls-assets\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288495    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-0\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288508    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.288543 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288529    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288641 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288555    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-kube-rbac-proxy\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.288641 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.288641 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288579    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-thanos-prometheus-http-client-file\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288846    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-1\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-config-out\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-serving-certs-ca-bundle\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-db\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.288993    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.289025    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-tls\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.289072    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-trusted-ca-bundle\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.289110    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-metrics-client-ca\") pod \"c33de62f-c204-4352-8367-6f5bac31856b\" (UID: \"c33de62f-c204-4352-8367-6f5bac31856b\") "
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.289489    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.289514    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.289864    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.290503    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.290738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.290708    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.291679 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.291603    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.292838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292219    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.292838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292367    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-kube-api-access-qpc6x" (OuterVolumeSpecName: "kube-api-access-qpc6x") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "kube-api-access-qpc6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:45:01.292838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292602    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.292838 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292727    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:45:01.293212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292877    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.293212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292924    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:45:01.293212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.292943    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.293212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.293021    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.293212 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.293169    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:45:01.293488 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.293456    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-config" (OuterVolumeSpecName: "config") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.293583 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.293497    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.294281 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.294254    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-config-out" (OuterVolumeSpecName: "config-out") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:45:01.294500 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.294472    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.303338 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.303312    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-web-config" (OuterVolumeSpecName: "web-config") pod "c33de62f-c204-4352-8367-6f5bac31856b" (UID: "c33de62f-c204-4352-8367-6f5bac31856b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:45:01.390729 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390674    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.390729 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390721    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-db\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.390729 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390735    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390749    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390761    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390775    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-configmap-metrics-client-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390818    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpc6x\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-kube-api-access-qpc6x\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390832    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-web-config\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390843    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-grpc-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390853    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-config\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390866    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-metrics-client-certs\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390877    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c33de62f-c204-4352-8367-6f5bac31856b-tls-assets\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390888    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390901    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390917    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-secret-kube-rbac-proxy\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390930    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c33de62f-c204-4352-8367-6f5bac31856b-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390943    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c33de62f-c204-4352-8367-6f5bac31856b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:01.391057 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:01.390954    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c33de62f-c204-4352-8367-6f5bac31856b-config-out\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:45:02.066572 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.066539    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cszs7" event={"ID":"894d176c-ac2c-4562-82df-3c58378aa6eb","Type":"ContainerStarted","Data":"813973a0b957bcf6e0ac6a048e9531699418016d14bb7e9b12e2d96fbaf6644c"}
Jul 15 16:45:02.067047 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.066590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cszs7" event={"ID":"894d176c-ac2c-4562-82df-3c58378aa6eb","Type":"ContainerStarted","Data":"78f5fb647da00bebdbe54cf74d33c9af21f45578634a69ea596c619132674795"}
Jul 15 16:45:02.067047 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.066645    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cszs7"
Jul 15 16:45:02.070035 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.070004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c33de62f-c204-4352-8367-6f5bac31856b","Type":"ContainerDied","Data":"228d387abeb97d786e4d07f04e71e505e888b10fc036e5f787790432c8f0daf4"}
Jul 15 16:45:02.070199 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.070035    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.070199 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.070083    2575 scope.go:117] "RemoveContainer" containerID="e122689c69381271fb762db6f9e6710f298e560a4cb80a43cbde7d01dcae0147"
Jul 15 16:45:02.077965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.077950    2575 scope.go:117] "RemoveContainer" containerID="c3b6f5ccf0e2c57f7268dfbd5bd348eba6d9f9a8981971f1e324f0f174b5e413"
Jul 15 16:45:02.085551 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.085441    2575 scope.go:117] "RemoveContainer" containerID="41ce409e40bab456002d1e12dc6c1e63605f9b934ddf4fdbd949740863edd64b"
Jul 15 16:45:02.086297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.086254    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cszs7" podStartSLOduration=251.548101001 podStartE2EDuration="4m13.086239181s" totalImagesPullingTime="1.53813818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:40:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:02.084452154 +0000 UTC m=+288.654327452" watchObservedRunningTime="2026-07-15 16:45:02.086239181 +0000 UTC m=+288.656114511"
Jul 15 16:45:02.092801 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.092762    2575 scope.go:117] "RemoveContainer" containerID="4ec2588a2191b2411d25b3175a31a9a62c9f2c8d363eea2ea558b98e0ce38749"
Jul 15 16:45:02.101281 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.101180    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:45:02.101400 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.101380    2575 scope.go:117] "RemoveContainer" containerID="5a29230b6667c5cc3eaa03bd92770328a0ea4942c56dbda5a8407aea2f9eb0a4"
Jul 15 16:45:02.106258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.106238    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:45:02.111304 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.111283    2575 scope.go:117] "RemoveContainer" containerID="dc1c168ed8270f6201b3c7834d2b9ced27a847dad1ab373a01bbdbae29689de9"
Jul 15 16:45:02.121644 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.121628    2575 scope.go:117] "RemoveContainer" containerID="3fd1df1662d7862a37bbd6a60128e823cebd183c832179c8458e4c10e4054098"
Jul 15 16:45:02.131004 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.130984    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:45:02.131250 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131239    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerName="registry"
Jul 15 16:45:02.131286 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131252    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerName="registry"
Jul 15 16:45:02.131286 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131262    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="thanos-sidecar"
Jul 15 16:45:02.131286 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131268    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="thanos-sidecar"
Jul 15 16:45:02.131286 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131275    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="config-reloader"
Jul 15 16:45:02.131286 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131281    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="config-reloader"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131295    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131302    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131309    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="init-config-reloader"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131315    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="init-config-reloader"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131321    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-web"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131327    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-web"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131332    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-thanos"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131337    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-thanos"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131344    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="prometheus"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131350    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="prometheus"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131388    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e069128c-71f4-436b-b9e1-ba356fdf1429" containerName="registry"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131397    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="prometheus"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131403    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-web"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131409    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="thanos-sidecar"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131414    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy-thanos"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131419    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="config-reloader"
Jul 15 16:45:02.131434 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.131424    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33de62f-c204-4352-8367-6f5bac31856b" containerName="kube-rbac-proxy"
Jul 15 16:45:02.135097 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.135076    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.137910 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.137888    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 16:45:02.138046 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.137926    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 16:45:02.138046 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.137958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 16:45:02.138046 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.138006    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 16:45:02.139482 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.138963    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 16:45:02.139482 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.139092    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 16:45:02.141205 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.140814    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ld8xt\""
Jul 15 16:45:02.141205 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.140938    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 16:45:02.141538 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.141518    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 16:45:02.141737 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.141721    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 16:45:02.142820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.141977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 16:45:02.142820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.142274    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 16:45:02.142820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.142384    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 16:45:02.144403 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.144382    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8jo966adff0ct\""
Jul 15 16:45:02.147029 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.147008    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 16:45:02.148707 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.148687    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 16:45:02.150672 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.150654    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:45:02.197365 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197365 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6388fb3e-536b-45f8-b176-85f30ccea8d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdqr\" (UniqueName: \"kubernetes.io/projected/6388fb3e-536b-45f8-b176-85f30ccea8d4-kube-api-access-jfdqr\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197597 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-config\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197712    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.197911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.198162 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.198162 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.198162 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.197989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6388fb3e-536b-45f8-b176-85f30ccea8d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.198162 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.198012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.198162 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.198046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299379    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299419    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6388fb3e-536b-45f8-b176-85f30ccea8d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299480    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdqr\" (UniqueName: \"kubernetes.io/projected/6388fb3e-536b-45f8-b176-85f30ccea8d4-kube-api-access-jfdqr\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-config\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299653    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.299770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.300381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.300381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6388fb3e-536b-45f8-b176-85f30ccea8d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.300381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.300381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.299876    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.300381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.300273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.302988 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.302652    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.302988 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.302725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6388fb3e-536b-45f8-b176-85f30ccea8d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.302988 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.302869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.302988 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.302936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303288 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.302990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303288 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303115    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303288 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303270    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303709 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303845 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303822    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303923 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.303923 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.304029 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.303925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.304367 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.304312    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.304659 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.304596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6388fb3e-536b-45f8-b176-85f30ccea8d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.305757 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.305738    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-config\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.306400 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.306374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6388fb3e-536b-45f8-b176-85f30ccea8d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.306607 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.306584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.306684 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.306625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6388fb3e-536b-45f8-b176-85f30ccea8d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.308258 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.308235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdqr\" (UniqueName: \"kubernetes.io/projected/6388fb3e-536b-45f8-b176-85f30ccea8d4-kube-api-access-jfdqr\") pod \"prometheus-k8s-0\" (UID: \"6388fb3e-536b-45f8-b176-85f30ccea8d4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.447984 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.447941    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:02.591540 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:02.591509    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 16:45:02.595053 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:45:02.595024    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6388fb3e_536b_45f8_b176_85f30ccea8d4.slice/crio-7255fb22d67ee7ae98f8b1c308eb00dc2a5c993a5179338bdcdf87087393211b WatchSource:0}: Error finding container 7255fb22d67ee7ae98f8b1c308eb00dc2a5c993a5179338bdcdf87087393211b: Status 404 returned error can't find the container with id 7255fb22d67ee7ae98f8b1c308eb00dc2a5c993a5179338bdcdf87087393211b
Jul 15 16:45:03.076609 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:03.076571    2575 generic.go:356] "Generic (PLEG): container finished" podID="6388fb3e-536b-45f8-b176-85f30ccea8d4" containerID="c01733ce0dbdafd7ad625af25ab26bfcec0d9dcbdf70e7931df12b33789a2f48" exitCode=0
Jul 15 16:45:03.077022 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:03.076661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerDied","Data":"c01733ce0dbdafd7ad625af25ab26bfcec0d9dcbdf70e7931df12b33789a2f48"}
Jul 15 16:45:03.077022 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:03.076733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"7255fb22d67ee7ae98f8b1c308eb00dc2a5c993a5179338bdcdf87087393211b"}
Jul 15 16:45:04.023988 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.023955    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c33de62f-c204-4352-8367-6f5bac31856b" path="/var/lib/kubelet/pods/c33de62f-c204-4352-8367-6f5bac31856b/volumes"
Jul 15 16:45:04.084018 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.083984    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"50d6b5bc287445ba9a6d7f84ba48bc51d9a92904ce9e0e10839ea1434b4ed0f9"}
Jul 15 16:45:04.084432 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.084053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"f328e74a8146bd7b2a740b28c26144bc7bd3cbffe03451b0f557457a1ae1844c"}
Jul 15 16:45:04.084432 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.084080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"481b365fc0bab2522ce2de55d38e9006a9687fb537682a5cf1ce70ab8a1df322"}
Jul 15 16:45:04.084432 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.084104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"88e4623ad83fab30fe084866eea388efe55b4580bdebf3d05559ae8225003bd3"}
Jul 15 16:45:04.084432 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.084137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"c9af6ddf516b15207950830f4a1577f68d77b48a6a1282cd9359ec0c1a5efd8f"}
Jul 15 16:45:04.084432 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.084162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6388fb3e-536b-45f8-b176-85f30ccea8d4","Type":"ContainerStarted","Data":"9595b6331f778d1c57589828d349d6e7f8b11be1aed36f005f9d693663ad24af"}
Jul 15 16:45:04.112714 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:04.112646    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.089015501 podStartE2EDuration="2.112623308s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.607807ms" isStatefulPod=false podCreationTimestamp="2026-07-15 16:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:45:04.111118354 +0000 UTC m=+290.680993689" watchObservedRunningTime="2026-07-15 16:45:04.112623308 +0000 UTC m=+290.682498608"
Jul 15 16:45:06.976517 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:06.976480    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:07.090638 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:07.090599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:07.448871 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:07.448828    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:45:08.832215 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:08.832179    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:08.893152 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:08.893121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:09.277536 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:09.277447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:10.735510 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:10.735480    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:45:10.871623 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:10.871586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:10.934002 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:10.933965    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:12.079455 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:12.079426    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cszs7"
Jul 15 16:45:12.190598 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:12.190566    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:13.846859 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:13.846825    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:45:13.848814 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:13.848769    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:45:13.854243 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:13.854223    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 16:45:14.444807 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:14.444758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:14.503886 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:14.503847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:14.561216 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:14.561180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:15.175053 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:15.175019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:15.227391 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:15.227358    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:21.674326 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:21.674265    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:21.774737 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:21.774689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:24.244915 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:24.244875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:24.299580 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:24.299540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:25.753805 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:25.753738    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" podUID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerName="registry" containerID="cri-o://09c7e86f0e34966275a78e063e248b9fd532f70ff66e8d5db74c6975ce893fd4" gracePeriod=30
Jul 15 16:45:27.180814 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:27.180757    2575 generic.go:356] "Generic (PLEG): container finished" podID="04fbdd42-e9a9-4a79-b166-b12da2fdd241" containerID="09c7e86f0e34966275a78e063e248b9fd532f70ff66e8d5db74c6975ce893fd4" exitCode=0
Jul 15 16:45:27.181317 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:27.180835    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" event={"ID":"04fbdd42-e9a9-4a79-b166-b12da2fdd241","Type":"ContainerDied","Data":"09c7e86f0e34966275a78e063e248b9fd532f70ff66e8d5db74c6975ce893fd4"}
Jul 15 16:45:27.181317 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:27.180900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m" event={"ID":"04fbdd42-e9a9-4a79-b166-b12da2fdd241","Type":"ContainerStarted","Data":"dd3722f9bd6a51da66e9092f4cad8e77a2f609fbbb53c866a4c6855d5c0b47e2"}
Jul 15 16:45:27.181317 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:27.180918    2575 scope.go:117] "RemoveContainer" containerID="425ed31af3e08b8c3f8a10376cbad5d45d4acef19eae710f8f0e135eef48386f"
Jul 15 16:45:27.181317 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:27.180928    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:45:28.467241 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:28.467196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:28.520389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:28.520345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:33.183821 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:33.183770    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:33.249199 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:33.249160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:40.420440 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:40.420400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:40.492327 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:40.492286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:40.545402 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:40.545363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:48.175939 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:48.175890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:48.191743 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:48.191717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56879b6cb7-gzz7m"
Jul 15 16:45:48.276048 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:48.276013    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:48.481722 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:48.481623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:48.543180 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:48.543143    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:52.183131 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:52.183092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:45:52.242203 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:45:52.242167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:02.448408 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:02.448367    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:46:02.464249 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:02.464222    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:46:03.172648 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:03.172613    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:03.228573 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:03.228532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:03.330750 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:03.330724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 16:46:10.731767 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:10.731691    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:10.786322 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:10.786291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:27.281376 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:27.281338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:27.342389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:27.342357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:30.271716 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:30.271673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:33.227146 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:33.227113    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:33.285666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:33.285629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:36.984950 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:36.984910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:37.096106 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:37.096077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:37.915840 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:37.915779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:37.971415 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:37.971383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:47.943464 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:47.943427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:46:48.110398 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:46:48.110363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:12.592965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:12.592934    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:12.688137 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:12.688107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:40.192972 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:40.192903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:46.495738 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:46.495703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:46.598583 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:46.598554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:47.770023 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:47.769992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:47.858734 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:47.858706    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:49.982489 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:49.982460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:50.167018 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:50.166989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:50.530619 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:50.530593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:52.809679 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:52.809648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:52.910028 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:52.909999    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:47:58.181289 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:47:58.181245    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:15.436510 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:15.436477    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:16.651919 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:16.651881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:17.010206 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:17.010136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:17.111769 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:17.111740    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:23.023167 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:23.023124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:23.125002 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:23.124947    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:24.808593 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:24.808562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:29.052344 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.052304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:29.117579 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.117552    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"]
Jul 15 16:48:29.120781 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.120765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.122692 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.122670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:29.123421 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.123397    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 16:48:29.123421 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.123420    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 16:48:29.124499 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.124478    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 16:48:29.124605 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.124486    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v5rbw\""
Jul 15 16:48:29.124605 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.124545    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 16:48:29.124723 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.124603    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 16:48:29.132840 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.132820    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"]
Jul 15 16:48:29.230254 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.230220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-cert\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.230353 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.230285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-manager-config\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.230353 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.230335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vhjh\" (UniqueName: \"kubernetes.io/projected/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-kube-api-access-9vhjh\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.230428 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.230365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-metrics-cert\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.331486 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.331460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-cert\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.331586 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.331506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-manager-config\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.331586 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.331529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vhjh\" (UniqueName: \"kubernetes.io/projected/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-kube-api-access-9vhjh\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.331586 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.331554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-metrics-cert\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.332056 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.332036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-manager-config\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.333888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.333869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-cert\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.333991 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.333975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-metrics-cert\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.340782 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.340764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vhjh\" (UniqueName: \"kubernetes.io/projected/6bc9e6c9-33b8-4691-aaea-2e4f6f929278-kube-api-access-9vhjh\") pod \"lws-controller-manager-5c79d97d55-4vv7p\" (UID: \"6bc9e6c9-33b8-4691-aaea-2e4f6f929278\") " pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.429728 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.429709    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:29.558195 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.558173    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"]
Jul 15 16:48:29.560518 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:48:29.560481    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc9e6c9_33b8_4691_aaea_2e4f6f929278.slice/crio-867f08c6f28e4cd678e79b83240d86762a629f853106cc446045528c20b57d9c WatchSource:0}: Error finding container 867f08c6f28e4cd678e79b83240d86762a629f853106cc446045528c20b57d9c: Status 404 returned error can't find the container with id 867f08c6f28e4cd678e79b83240d86762a629f853106cc446045528c20b57d9c
Jul 15 16:48:29.562329 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.562314    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:48:29.842010 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:29.841982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p" event={"ID":"6bc9e6c9-33b8-4691-aaea-2e4f6f929278","Type":"ContainerStarted","Data":"867f08c6f28e4cd678e79b83240d86762a629f853106cc446045528c20b57d9c"}
Jul 15 16:48:33.860032 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:33.859996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p" event={"ID":"6bc9e6c9-33b8-4691-aaea-2e4f6f929278","Type":"ContainerStarted","Data":"352b1a11eb00ee2bd802bafeafbf7e086ce8b04b24bec20f68d685816af36181"}
Jul 15 16:48:33.860459 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:33.860070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:33.878269 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:33.878225    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p" podStartSLOduration=1.392115318 podStartE2EDuration="4.878211415s" totalImagesPullingTime="3.486096097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:33.877282153 +0000 UTC m=+500.447157448" watchObservedRunningTime="2026-07-15 16:48:33.878211415 +0000 UTC m=+500.448086722"
Jul 15 16:48:41.013540 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.013505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:41.110075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.110046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:41.958684 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.958651    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"]
Jul 15 16:48:41.961981 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.961962    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:41.964719 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.964684    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 16:48:41.964719 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.964699    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 16:48:41.964929 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.964756    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-htrvj\""
Jul 15 16:48:41.964929 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.964844    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 16:48:41.965010 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.964951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 16:48:41.976075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:41.976054    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"]
Jul 15 16:48:42.125655 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.125634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53f8061b-2c84-4583-a41a-5495d8bde155-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.125982 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.125671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/53f8061b-2c84-4583-a41a-5495d8bde155-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.125982 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.125691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53f8061b-2c84-4583-a41a-5495d8bde155-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.125982 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.125711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53f8061b-2c84-4583-a41a-5495d8bde155-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.125982 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.125802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wdp\" (UniqueName: \"kubernetes.io/projected/53f8061b-2c84-4583-a41a-5495d8bde155-kube-api-access-g4wdp\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.226809 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.226726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wdp\" (UniqueName: \"kubernetes.io/projected/53f8061b-2c84-4583-a41a-5495d8bde155-kube-api-access-g4wdp\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.226809 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.226775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53f8061b-2c84-4583-a41a-5495d8bde155-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.226949 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.226818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/53f8061b-2c84-4583-a41a-5495d8bde155-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.226949 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.226836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53f8061b-2c84-4583-a41a-5495d8bde155-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.226949 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.226857    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53f8061b-2c84-4583-a41a-5495d8bde155-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.227406 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.227382    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/53f8061b-2c84-4583-a41a-5495d8bde155-manifests\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.229061 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.229040    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53f8061b-2c84-4583-a41a-5495d8bde155-tmp\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.229139 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.229093    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/53f8061b-2c84-4583-a41a-5495d8bde155-webhook-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.229265 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.229249    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/53f8061b-2c84-4583-a41a-5495d8bde155-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.241772 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.241750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wdp\" (UniqueName: \"kubernetes.io/projected/53f8061b-2c84-4583-a41a-5495d8bde155-kube-api-access-g4wdp\") pod \"opendatahub-operator-controller-manager-9487b7458-tbn9r\" (UID: \"53f8061b-2c84-4583-a41a-5495d8bde155\") " pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.272201 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.272174    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:42.404817 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.404777    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"]
Jul 15 16:48:42.407708 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:48:42.407686    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f8061b_2c84_4583_a41a_5495d8bde155.slice/crio-89b1ae804b25a02d09a9a35c0d7e8b360a843bd1435b3e94843f322826c55d71 WatchSource:0}: Error finding container 89b1ae804b25a02d09a9a35c0d7e8b360a843bd1435b3e94843f322826c55d71: Status 404 returned error can't find the container with id 89b1ae804b25a02d09a9a35c0d7e8b360a843bd1435b3e94843f322826c55d71
Jul 15 16:48:42.896407 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:42.896377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r" event={"ID":"53f8061b-2c84-4583-a41a-5495d8bde155","Type":"ContainerStarted","Data":"89b1ae804b25a02d09a9a35c0d7e8b360a843bd1435b3e94843f322826c55d71"}
Jul 15 16:48:43.321695 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:43.321612    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:43.431366 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:43.431333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:44.866045 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:44.866013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c79d97d55-4vv7p"
Jul 15 16:48:47.917498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:47.917462    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r" event={"ID":"53f8061b-2c84-4583-a41a-5495d8bde155","Type":"ContainerStarted","Data":"8b7306aa3a68e684d4e14978f0c887a9f3c9a300c910c852674e217ba33fe160"}
Jul 15 16:48:48.922802 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:48.922751    2575 generic.go:356] "Generic (PLEG): container finished" podID="53f8061b-2c84-4583-a41a-5495d8bde155" containerID="8b7306aa3a68e684d4e14978f0c887a9f3c9a300c910c852674e217ba33fe160" exitCode=0
Jul 15 16:48:48.923134 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:48.922839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r" event={"ID":"53f8061b-2c84-4583-a41a-5495d8bde155","Type":"ContainerDied","Data":"8b7306aa3a68e684d4e14978f0c887a9f3c9a300c910c852674e217ba33fe160"}
Jul 15 16:48:49.928502 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:49.928468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r" event={"ID":"53f8061b-2c84-4583-a41a-5495d8bde155","Type":"ContainerStarted","Data":"e53851b56f3394bda5ca9bcb8ec28ccf50d52b98a45dfa101b8db33c99d467bd"}
Jul 15 16:48:49.928908 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:49.928619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:48:49.952381 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:49.952332    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r" podStartSLOduration=2.9167338369999998 podStartE2EDuration="8.952318875s" totalImagesPullingTime="4.970142369s" totalInitContainerRuntime="1.065442669s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:48:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:48:49.949808116 +0000 UTC m=+516.519683411" watchObservedRunningTime="2026-07-15 16:48:49.952318875 +0000 UTC m=+516.522194171"
Jul 15 16:48:54.032562 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:54.032531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:54.126219 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:54.126185    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:56.818463 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:56.818431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:56.867806 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:56.867767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:57.245608 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:57.245580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:57.346555 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:57.346523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:58.437450 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:58.437420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:48:58.488892 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:48:58.488863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:00.396196 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:00.396159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:00.452389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:00.452357    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:00.934850 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:00.934825    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9487b7458-tbn9r"
Jul 15 16:49:02.672020 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:02.671984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:02.797127 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:02.797079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:03.290081 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.290052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:03.448684 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.448656    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"]
Jul 15 16:49:03.460323 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.460298    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.463847 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.463824    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 16:49:03.464577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.464559    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-48b2t\""
Jul 15 16:49:03.464577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.464569    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 16:49:03.473160 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.473140    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"]
Jul 15 16:49:03.485002 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.484978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwp8v\" (UniqueName: \"kubernetes.io/projected/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-kube-api-access-pwp8v\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.485095 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.485058    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-tmp\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.485095 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.485085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-tls-certs\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.542563 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.542470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:03.586315 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.586291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-tmp\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.586460 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.586329    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-tls-certs\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.586460 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.586349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwp8v\" (UniqueName: \"kubernetes.io/projected/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-kube-api-access-pwp8v\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.588537 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.588513    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-tmp\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.588685 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.588668    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-tls-certs\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.598780 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.598755    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwp8v\" (UniqueName: \"kubernetes.io/projected/e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf-kube-api-access-pwp8v\") pod \"kube-auth-proxy-fbd7ccb4-5pkcd\" (UID: \"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf\") " pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.641860 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.641822    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:03.769481 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.769460    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"
Jul 15 16:49:03.896377 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.896353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd"]
Jul 15 16:49:03.898683 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:49:03.898651    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a6bfaf_9bd0_4bb3_b7b7_32dd9f135cdf.slice/crio-ce77e38453c8fb695e19005e72b30bb9c4f783976deabc2b477dbdc2b4c990eb WatchSource:0}: Error finding container ce77e38453c8fb695e19005e72b30bb9c4f783976deabc2b477dbdc2b4c990eb: Status 404 returned error can't find the container with id ce77e38453c8fb695e19005e72b30bb9c4f783976deabc2b477dbdc2b4c990eb
Jul 15 16:49:03.979329 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:03.979295    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd" event={"ID":"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf","Type":"ContainerStarted","Data":"ce77e38453c8fb695e19005e72b30bb9c4f783976deabc2b477dbdc2b4c990eb"}
Jul 15 16:49:04.122075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:04.122039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:04.277965 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:04.277929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:04.377927 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:04.377836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:04.654218 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:04.654140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:04.751192 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:04.751156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:05.557573 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:05.557447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:06.992763 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:06.992675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd" event={"ID":"e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf","Type":"ContainerStarted","Data":"c99f29153a7f7b074ac4cea940026059fa8a60fec14eaa668f36b02caccb3c88"}
Jul 15 16:49:07.008990 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:07.008944    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fbd7ccb4-5pkcd" podStartSLOduration=1.262130628 podStartE2EDuration="4.008931283s" totalImagesPullingTime="2.746800655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:49:07.007457012 +0000 UTC m=+533.577332309" watchObservedRunningTime="2026-07-15 16:49:07.008931283 +0000 UTC m=+533.578806579"
Jul 15 16:49:10.187745 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:10.187699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:10.289855 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:10.289821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:11.070348 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:11.070314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:11.242298 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:11.242268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:11.340713 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:11.340687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:13.257567 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:13.257537    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:13.363219 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:13.363189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:13.433273 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:13.433242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:14.533132 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:14.533056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:14.629565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:14.629501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:14.770967 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:14.770936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:15.771015 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:15.770985    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:15.825753 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:15.825726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:16.650035 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:16.649994    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:16.703378 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:16.703343    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:25.942674 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:25.942632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:26.043310 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:26.043275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:45.078845 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:45.078813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:56.794839 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:56.794774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:58.691590 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:58.691551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:49:58.792706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:49:58.792671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:04.132688 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:04.132656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:04.452150 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:04.452064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:04.550780 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:04.550746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:08.108313 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:08.108281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:08.209203 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:08.209173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:08.310895 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:08.310849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:08.841742 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:08.841705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:08.894113 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:08.894079    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:13.874149 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:13.874118    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:50:13.874841 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:13.874822    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:50:18.856830 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:18.856774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:19.317655 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:19.317542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:32.508822 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:32.508763    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:33.115331 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:33.115294    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:37.944608 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:37.944515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:39.983411 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:39.983372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:40.090318 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:40.090288    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:40.517095 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:40.517059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:43.145008 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:43.144976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:44.157080 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:44.157044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:46.366231 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:46.366195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:47.346906 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:47.346874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:48.468844 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:48.468806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:48.893865 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:48.893826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:49.316514 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:49.316416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:49.416880 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:49.416851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:49.719135 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:49.719095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:49.776528 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:49.776495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:53.313448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.313367    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:53.414460 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.414427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:53.734651 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.734610    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"]
Jul 15 16:50:53.737297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.737271    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.739721 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.739691    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 16:50:53.739868 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.739762    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 16:50:53.740003 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.739987    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 16:50:53.740827 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.740807    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 16:50:53.740943 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.740835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qdk7w\""
Jul 15 16:50:53.745225 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.745205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"]
Jul 15 16:50:53.746086 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.746057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:53.882236 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.882201    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zll\" (UniqueName: \"kubernetes.io/projected/c1ad4fe7-9406-4015-964c-e3f23685b74a-kube-api-access-n9zll\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.882452 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.882256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ad4fe7-9406-4015-964c-e3f23685b74a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.882452 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.882360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c1ad4fe7-9406-4015-964c-e3f23685b74a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.983672 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.983629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zll\" (UniqueName: \"kubernetes.io/projected/c1ad4fe7-9406-4015-964c-e3f23685b74a-kube-api-access-n9zll\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.983889 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.983730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ad4fe7-9406-4015-964c-e3f23685b74a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.983889 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.983815    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c1ad4fe7-9406-4015-964c-e3f23685b74a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.983889 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:50:53.983879    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 15 16:50:53.984000 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:50:53.983968    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ad4fe7-9406-4015-964c-e3f23685b74a-plugin-serving-cert podName:c1ad4fe7-9406-4015-964c-e3f23685b74a nodeName:}" failed. No retries permitted until 2026-07-15 16:50:54.48394549 +0000 UTC m=+641.053820768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c1ad4fe7-9406-4015-964c-e3f23685b74a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-gknck" (UID: "c1ad4fe7-9406-4015-964c-e3f23685b74a") : secret "plugin-serving-cert" not found
Jul 15 16:50:53.984515 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.984497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c1ad4fe7-9406-4015-964c-e3f23685b74a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:53.994635 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:53.994561    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zll\" (UniqueName: \"kubernetes.io/projected/c1ad4fe7-9406-4015-964c-e3f23685b74a-kube-api-access-n9zll\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:54.314427 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:54.314318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:54.488695 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:54.488655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ad4fe7-9406-4015-964c-e3f23685b74a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:54.491172 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:54.491141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ad4fe7-9406-4015-964c-e3f23685b74a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gknck\" (UID: \"c1ad4fe7-9406-4015-964c-e3f23685b74a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:54.661335 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:54.661273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"
Jul 15 16:50:54.795364 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:54.795326    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gknck"]
Jul 15 16:50:54.798592 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:50:54.798559    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1ad4fe7_9406_4015_964c_e3f23685b74a.slice/crio-287b09536abb0fed25473764492d8879aadad28da4510d9921231e0d6f7637cb WatchSource:0}: Error finding container 287b09536abb0fed25473764492d8879aadad28da4510d9921231e0d6f7637cb: Status 404 returned error can't find the container with id 287b09536abb0fed25473764492d8879aadad28da4510d9921231e0d6f7637cb
Jul 15 16:50:55.442921 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:55.442882    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck" event={"ID":"c1ad4fe7-9406-4015-964c-e3f23685b74a","Type":"ContainerStarted","Data":"287b09536abb0fed25473764492d8879aadad28da4510d9921231e0d6f7637cb"}
Jul 15 16:50:56.518237 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:56.518156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:50:56.757261 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:50:56.757194    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:01.173846 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:01.173803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:02.946126 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:02.946095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:04.214103 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.214043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:04.814389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.814355    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"]
Jul 15 16:51:04.842581 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.842545    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"]
Jul 15 16:51:04.842769 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.842691    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:04.846195 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.846163    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qmq6r\""
Jul 15 16:51:04.885890 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.885857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e7582a-084f-469f-934f-26da62357322-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-whzbr\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:04.886049 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.885926    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/72e7582a-084f-469f-934f-26da62357322-kube-api-access-rzltl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-whzbr\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:04.987003 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.986963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/72e7582a-084f-469f-934f-26da62357322-kube-api-access-rzltl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-whzbr\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:04.987210 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.987089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e7582a-084f-469f-934f-26da62357322-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-whzbr\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:04.987602 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.987574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e7582a-084f-469f-934f-26da62357322-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-whzbr\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:04.997010 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:04.996976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/72e7582a-084f-469f-934f-26da62357322-kube-api-access-rzltl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-whzbr\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:05.160025 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:05.159978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:08.499846 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:08.499782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:08.558664 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:08.558623    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:09.100906 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:09.100865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:09.210321 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:09.210281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:12.500266 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:12.500226    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:12.601036 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:12.600999    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:16.138246 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:16.138206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:16.303987 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:16.303945    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:17.078282 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:17.078241    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"]
Jul 15 16:51:17.082519 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:51:17.082485    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e7582a_084f_469f_934f_26da62357322.slice/crio-4e0f7c81a6ef130a1b08b7993d3f14eea1016b14ea8484fc6e366bf45a2b6916 WatchSource:0}: Error finding container 4e0f7c81a6ef130a1b08b7993d3f14eea1016b14ea8484fc6e366bf45a2b6916: Status 404 returned error can't find the container with id 4e0f7c81a6ef130a1b08b7993d3f14eea1016b14ea8484fc6e366bf45a2b6916
Jul 15 16:51:17.556345 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:17.556250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr" event={"ID":"72e7582a-084f-469f-934f-26da62357322","Type":"ContainerStarted","Data":"4e0f7c81a6ef130a1b08b7993d3f14eea1016b14ea8484fc6e366bf45a2b6916"}
Jul 15 16:51:18.563420 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:18.563378    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck" event={"ID":"c1ad4fe7-9406-4015-964c-e3f23685b74a","Type":"ContainerStarted","Data":"1e8e776ae4eee4d2e3c43cc5964944e41099641f7bcbd39978e2d843a89142f6"}
Jul 15 16:51:18.580324 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:18.580269    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gknck" podStartSLOduration=2.469047804 podStartE2EDuration="25.580252047s" totalImagesPullingTime="23.111204243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:18.579152421 +0000 UTC m=+665.149027717" watchObservedRunningTime="2026-07-15 16:51:18.580252047 +0000 UTC m=+665.150127342"
Jul 15 16:51:21.767196 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:21.767154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:21.827117 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:21.827069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:22.584268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:22.584233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr" event={"ID":"72e7582a-084f-469f-934f-26da62357322","Type":"ContainerStarted","Data":"9bdeb9b60ff7322da038d2e4b758c5488c59fc39a2c7485372183bc5d8813058"}
Jul 15 16:51:22.584468 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:22.584341    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:22.604808 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:22.604738    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr" podStartSLOduration=13.928543695 podStartE2EDuration="18.604716156s" totalImagesPullingTime="4.676172461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:22.603487948 +0000 UTC m=+669.173363246" watchObservedRunningTime="2026-07-15 16:51:22.604716156 +0000 UTC m=+669.174591453"
Jul 15 16:51:33.593769 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:33.593739    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:36.893689 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:36.893655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:46.132633 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:46.132595    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"]
Jul 15 16:51:46.133183 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:46.132881    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr" podUID="72e7582a-084f-469f-934f-26da62357322" containerName="manager" containerID="cri-o://9bdeb9b60ff7322da038d2e4b758c5488c59fc39a2c7485372183bc5d8813058" gracePeriod=10
Jul 15 16:51:46.691946 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:46.691909    2575 generic.go:356] "Generic (PLEG): container finished" podID="72e7582a-084f-469f-934f-26da62357322" containerID="9bdeb9b60ff7322da038d2e4b758c5488c59fc39a2c7485372183bc5d8813058" exitCode=0
Jul 15 16:51:46.692157 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:46.691972    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr" event={"ID":"72e7582a-084f-469f-934f-26da62357322","Type":"ContainerDied","Data":"9bdeb9b60ff7322da038d2e4b758c5488c59fc39a2c7485372183bc5d8813058"}
Jul 15 16:51:47.129371 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.129335    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:47.173338 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.173303    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/72e7582a-084f-469f-934f-26da62357322-kube-api-access-rzltl\") pod \"72e7582a-084f-469f-934f-26da62357322\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") "
Jul 15 16:51:47.173733 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.173360    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e7582a-084f-469f-934f-26da62357322-extensions-socket-volume\") pod \"72e7582a-084f-469f-934f-26da62357322\" (UID: \"72e7582a-084f-469f-934f-26da62357322\") "
Jul 15 16:51:47.173916 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.173891    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e7582a-084f-469f-934f-26da62357322-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72e7582a-084f-469f-934f-26da62357322" (UID: "72e7582a-084f-469f-934f-26da62357322"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 16:51:47.175625 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.175601    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e7582a-084f-469f-934f-26da62357322-kube-api-access-rzltl" (OuterVolumeSpecName: "kube-api-access-rzltl") pod "72e7582a-084f-469f-934f-26da62357322" (UID: "72e7582a-084f-469f-934f-26da62357322"). InnerVolumeSpecName "kube-api-access-rzltl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:51:47.274756 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.274667    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e7582a-084f-469f-934f-26da62357322-extensions-socket-volume\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:51:47.274756 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.274710    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzltl\" (UniqueName: \"kubernetes.io/projected/72e7582a-084f-469f-934f-26da62357322-kube-api-access-rzltl\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:51:47.697891 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.697858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr" event={"ID":"72e7582a-084f-469f-934f-26da62357322","Type":"ContainerDied","Data":"4e0f7c81a6ef130a1b08b7993d3f14eea1016b14ea8484fc6e366bf45a2b6916"}
Jul 15 16:51:47.698062 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.697908    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"
Jul 15 16:51:47.698062 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.697921    2575 scope.go:117] "RemoveContainer" containerID="9bdeb9b60ff7322da038d2e4b758c5488c59fc39a2c7485372183bc5d8813058"
Jul 15 16:51:47.719776 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.719745    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"]
Jul 15 16:51:47.725457 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:47.725434    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-whzbr"]
Jul 15 16:51:48.023549 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:48.023479    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e7582a-084f-469f-934f-26da62357322" path="/var/lib/kubelet/pods/72e7582a-084f-469f-934f-26da62357322/volumes"
Jul 15 16:51:49.995144 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:49.995110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:50.331761 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:50.331730    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:52.455565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.455526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:52.461766 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.461738    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:51:52.462141 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.462128    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e7582a-084f-469f-934f-26da62357322" containerName="manager"
Jul 15 16:51:52.462191 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.462142    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e7582a-084f-469f-934f-26da62357322" containerName="manager"
Jul 15 16:51:52.462227 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.462205    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e7582a-084f-469f-934f-26da62357322" containerName="manager"
Jul 15 16:51:52.491473 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.491442    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:51:52.491640 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.491569    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.494209 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.494188    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 16:51:52.521688 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.521652    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a57c2d1-14df-42b5-8ec5-49122373b6ce-config-file\") pod \"limitador-limitador-64c94fd64f-l4498\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.521688 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.521692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7wf\" (UniqueName: \"kubernetes.io/projected/7a57c2d1-14df-42b5-8ec5-49122373b6ce-kube-api-access-fr7wf\") pod \"limitador-limitador-64c94fd64f-l4498\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.558121 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.558086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:51:52.566169 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.566136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:52.621085 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.621049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:52.623129 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.623111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a57c2d1-14df-42b5-8ec5-49122373b6ce-config-file\") pod \"limitador-limitador-64c94fd64f-l4498\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.623196 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.623142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7wf\" (UniqueName: \"kubernetes.io/projected/7a57c2d1-14df-42b5-8ec5-49122373b6ce-kube-api-access-fr7wf\") pod \"limitador-limitador-64c94fd64f-l4498\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.623725 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.623708    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a57c2d1-14df-42b5-8ec5-49122373b6ce-config-file\") pod \"limitador-limitador-64c94fd64f-l4498\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.631032 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.631006    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7wf\" (UniqueName: \"kubernetes.io/projected/7a57c2d1-14df-42b5-8ec5-49122373b6ce-kube-api-access-fr7wf\") pod \"limitador-limitador-64c94fd64f-l4498\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.802109 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.802010    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:52.935735 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:52.935710    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:51:52.938256 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:51:52.938227    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a57c2d1_14df_42b5_8ec5_49122373b6ce.slice/crio-b95860fc0cab10cc7100fc30306d9376a1368e0a8f24def3b0b13f01d0d9be4b WatchSource:0}: Error finding container b95860fc0cab10cc7100fc30306d9376a1368e0a8f24def3b0b13f01d0d9be4b: Status 404 returned error can't find the container with id b95860fc0cab10cc7100fc30306d9376a1368e0a8f24def3b0b13f01d0d9be4b
Jul 15 16:51:53.244352 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.244314    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wngc7"]
Jul 15 16:51:53.248886 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.248866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:51:53.251226 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.251203    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c25n2\""
Jul 15 16:51:53.254742 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.254721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wngc7"]
Jul 15 16:51:53.274922 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.274884    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:53.329305 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.329265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pln\" (UniqueName: \"kubernetes.io/projected/0cc740a1-1192-4d90-838e-5cc1c4ed91df-kube-api-access-r5pln\") pod \"authorino-58cd955675-wngc7\" (UID: \"0cc740a1-1192-4d90-838e-5cc1c4ed91df\") " pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:51:53.430553 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.430518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pln\" (UniqueName: \"kubernetes.io/projected/0cc740a1-1192-4d90-838e-5cc1c4ed91df-kube-api-access-r5pln\") pod \"authorino-58cd955675-wngc7\" (UID: \"0cc740a1-1192-4d90-838e-5cc1c4ed91df\") " pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:51:53.438735 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.438701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pln\" (UniqueName: \"kubernetes.io/projected/0cc740a1-1192-4d90-838e-5cc1c4ed91df-kube-api-access-r5pln\") pod \"authorino-58cd955675-wngc7\" (UID: \"0cc740a1-1192-4d90-838e-5cc1c4ed91df\") " pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:51:53.506343 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.506256    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:51:53.541028 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.540992    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-thtpn"]
Jul 15 16:51:53.544262 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.544244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:51:53.552252 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.551983    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thtpn"]
Jul 15 16:51:53.560145 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.560118    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:51:53.632330 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.632291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv72t\" (UniqueName: \"kubernetes.io/projected/5715df24-149f-4ff7-8614-56c44dde5ef6-kube-api-access-zv72t\") pod \"authorino-75d556bd77-thtpn\" (UID: \"5715df24-149f-4ff7-8614-56c44dde5ef6\") " pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:51:53.694037 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.693887    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wngc7"]
Jul 15 16:51:53.696271 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:51:53.696246    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cc740a1_1192_4d90_838e_5cc1c4ed91df.slice/crio-70fc3ec1d479ebee796872aec6eb55a2bf4cb8e7ba9432f7fd81a32bd1ffe10c WatchSource:0}: Error finding container 70fc3ec1d479ebee796872aec6eb55a2bf4cb8e7ba9432f7fd81a32bd1ffe10c: Status 404 returned error can't find the container with id 70fc3ec1d479ebee796872aec6eb55a2bf4cb8e7ba9432f7fd81a32bd1ffe10c
Jul 15 16:51:53.725889 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.725846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498" event={"ID":"7a57c2d1-14df-42b5-8ec5-49122373b6ce","Type":"ContainerStarted","Data":"b95860fc0cab10cc7100fc30306d9376a1368e0a8f24def3b0b13f01d0d9be4b"}
Jul 15 16:51:53.726895 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.726872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wngc7" event={"ID":"0cc740a1-1192-4d90-838e-5cc1c4ed91df","Type":"ContainerStarted","Data":"70fc3ec1d479ebee796872aec6eb55a2bf4cb8e7ba9432f7fd81a32bd1ffe10c"}
Jul 15 16:51:53.733430 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.733401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv72t\" (UniqueName: \"kubernetes.io/projected/5715df24-149f-4ff7-8614-56c44dde5ef6-kube-api-access-zv72t\") pod \"authorino-75d556bd77-thtpn\" (UID: \"5715df24-149f-4ff7-8614-56c44dde5ef6\") " pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:51:53.741512 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.741487    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv72t\" (UniqueName: \"kubernetes.io/projected/5715df24-149f-4ff7-8614-56c44dde5ef6-kube-api-access-zv72t\") pod \"authorino-75d556bd77-thtpn\" (UID: \"5715df24-149f-4ff7-8614-56c44dde5ef6\") " pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:51:53.854902 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:53.854847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:51:54.045685 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:54.045652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thtpn"]
Jul 15 16:51:54.048832 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:51:54.048769    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5715df24_149f_4ff7_8614_56c44dde5ef6.slice/crio-282f11439bc1825b25976cf52e9fced023a549f57ffa5505d3dc001ca2d8f8d4 WatchSource:0}: Error finding container 282f11439bc1825b25976cf52e9fced023a549f57ffa5505d3dc001ca2d8f8d4: Status 404 returned error can't find the container with id 282f11439bc1825b25976cf52e9fced023a549f57ffa5505d3dc001ca2d8f8d4
Jul 15 16:51:54.739576 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:54.739537    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thtpn" event={"ID":"5715df24-149f-4ff7-8614-56c44dde5ef6","Type":"ContainerStarted","Data":"282f11439bc1825b25976cf52e9fced023a549f57ffa5505d3dc001ca2d8f8d4"}
Jul 15 16:51:58.760833 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.760781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wngc7" event={"ID":"0cc740a1-1192-4d90-838e-5cc1c4ed91df","Type":"ContainerStarted","Data":"00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41"}
Jul 15 16:51:58.762248 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.762217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thtpn" event={"ID":"5715df24-149f-4ff7-8614-56c44dde5ef6","Type":"ContainerStarted","Data":"2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4"}
Jul 15 16:51:58.763663 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.763638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498" event={"ID":"7a57c2d1-14df-42b5-8ec5-49122373b6ce","Type":"ContainerStarted","Data":"e30fe2f812b3d025b7b531773d256db3dcac84f22354eb578c5c8f1804b632c8"}
Jul 15 16:51:58.763770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.763756    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:51:58.777339 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.777274    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wngc7" podStartSLOduration=1.65233658 podStartE2EDuration="5.777258697s" totalImagesPullingTime="4.124922117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:58.775710792 +0000 UTC m=+705.345586092" watchObservedRunningTime="2026-07-15 16:51:58.777258697 +0000 UTC m=+705.347133993"
Jul 15 16:51:58.794904 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.794847    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-thtpn" podStartSLOduration=2.017708277 podStartE2EDuration="5.794829573s" totalImagesPullingTime="3.777121296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:58.793781188 +0000 UTC m=+705.363656485" watchObservedRunningTime="2026-07-15 16:51:58.794829573 +0000 UTC m=+705.364704868"
Jul 15 16:51:58.814179 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.814107    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498" podStartSLOduration=1.9314806249999998 podStartE2EDuration="6.814083685s" totalImagesPullingTime="4.88260306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:51:58.811983749 +0000 UTC m=+705.381859068" watchObservedRunningTime="2026-07-15 16:51:58.814083685 +0000 UTC m=+705.383958985"
Jul 15 16:51:58.820560 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:51:58.820526    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wngc7"]
Jul 15 16:52:00.772697 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:00.772657    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wngc7" podUID="0cc740a1-1192-4d90-838e-5cc1c4ed91df" containerName="authorino" containerID="cri-o://00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41" gracePeriod=30
Jul 15 16:52:01.023072 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.023007    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:52:01.102777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.102732    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5pln\" (UniqueName: \"kubernetes.io/projected/0cc740a1-1192-4d90-838e-5cc1c4ed91df-kube-api-access-r5pln\") pod \"0cc740a1-1192-4d90-838e-5cc1c4ed91df\" (UID: \"0cc740a1-1192-4d90-838e-5cc1c4ed91df\") "
Jul 15 16:52:01.104911 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.104884    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc740a1-1192-4d90-838e-5cc1c4ed91df-kube-api-access-r5pln" (OuterVolumeSpecName: "kube-api-access-r5pln") pod "0cc740a1-1192-4d90-838e-5cc1c4ed91df" (UID: "0cc740a1-1192-4d90-838e-5cc1c4ed91df"). InnerVolumeSpecName "kube-api-access-r5pln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:52:01.204435 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.204396    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5pln\" (UniqueName: \"kubernetes.io/projected/0cc740a1-1192-4d90-838e-5cc1c4ed91df-kube-api-access-r5pln\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:52:01.778991 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.778951    2575 generic.go:356] "Generic (PLEG): container finished" podID="0cc740a1-1192-4d90-838e-5cc1c4ed91df" containerID="00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41" exitCode=0
Jul 15 16:52:01.778991 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.778995    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wngc7"
Jul 15 16:52:01.779498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.779035    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wngc7" event={"ID":"0cc740a1-1192-4d90-838e-5cc1c4ed91df","Type":"ContainerDied","Data":"00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41"}
Jul 15 16:52:01.779498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.779080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wngc7" event={"ID":"0cc740a1-1192-4d90-838e-5cc1c4ed91df","Type":"ContainerDied","Data":"70fc3ec1d479ebee796872aec6eb55a2bf4cb8e7ba9432f7fd81a32bd1ffe10c"}
Jul 15 16:52:01.779498 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.779097    2575 scope.go:117] "RemoveContainer" containerID="00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41"
Jul 15 16:52:01.787803 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.787764    2575 scope.go:117] "RemoveContainer" containerID="00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41"
Jul 15 16:52:01.788072 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:52:01.788053    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41\": container with ID starting with 00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41 not found: ID does not exist" containerID="00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41"
Jul 15 16:52:01.788132 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.788082    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41"} err="failed to get container status \"00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41\": rpc error: code = NotFound desc = could not find container \"00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41\": container with ID starting with 00dac36c7eba11a507ea73a8519caddba240331f8d49719b3fdc6611a6766e41 not found: ID does not exist"
Jul 15 16:52:01.799781 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.799753    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wngc7"]
Jul 15 16:52:01.803513 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:01.803489    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wngc7"]
Jul 15 16:52:02.023705 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:02.023670    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc740a1-1192-4d90-838e-5cc1c4ed91df" path="/var/lib/kubelet/pods/0cc740a1-1192-4d90-838e-5cc1c4ed91df/volumes"
Jul 15 16:52:08.392725 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:08.392638    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:52:08.393175 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:08.392856    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498" podUID="7a57c2d1-14df-42b5-8ec5-49122373b6ce" containerName="limitador" containerID="cri-o://e30fe2f812b3d025b7b531773d256db3dcac84f22354eb578c5c8f1804b632c8" gracePeriod=30
Jul 15 16:52:08.393564 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:08.393544    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:52:08.816831 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:08.816782    2575 generic.go:356] "Generic (PLEG): container finished" podID="7a57c2d1-14df-42b5-8ec5-49122373b6ce" containerID="e30fe2f812b3d025b7b531773d256db3dcac84f22354eb578c5c8f1804b632c8" exitCode=0
Jul 15 16:52:08.816831 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:08.816824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498" event={"ID":"7a57c2d1-14df-42b5-8ec5-49122373b6ce","Type":"ContainerDied","Data":"e30fe2f812b3d025b7b531773d256db3dcac84f22354eb578c5c8f1804b632c8"}
Jul 15 16:52:08.951967 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:08.951907    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:52:09.078427 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.078396    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr7wf\" (UniqueName: \"kubernetes.io/projected/7a57c2d1-14df-42b5-8ec5-49122373b6ce-kube-api-access-fr7wf\") pod \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") "
Jul 15 16:52:09.078602 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.078436    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a57c2d1-14df-42b5-8ec5-49122373b6ce-config-file\") pod \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\" (UID: \"7a57c2d1-14df-42b5-8ec5-49122373b6ce\") "
Jul 15 16:52:09.078820 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.078780    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a57c2d1-14df-42b5-8ec5-49122373b6ce-config-file" (OuterVolumeSpecName: "config-file") pod "7a57c2d1-14df-42b5-8ec5-49122373b6ce" (UID: "7a57c2d1-14df-42b5-8ec5-49122373b6ce"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 16:52:09.080531 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.080504    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a57c2d1-14df-42b5-8ec5-49122373b6ce-kube-api-access-fr7wf" (OuterVolumeSpecName: "kube-api-access-fr7wf") pod "7a57c2d1-14df-42b5-8ec5-49122373b6ce" (UID: "7a57c2d1-14df-42b5-8ec5-49122373b6ce"). InnerVolumeSpecName "kube-api-access-fr7wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:52:09.179983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.179947    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr7wf\" (UniqueName: \"kubernetes.io/projected/7a57c2d1-14df-42b5-8ec5-49122373b6ce-kube-api-access-fr7wf\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:52:09.179983 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.179978    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a57c2d1-14df-42b5-8ec5-49122373b6ce-config-file\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:52:09.822519 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.822487    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498"
Jul 15 16:52:09.822958 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.822485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4498" event={"ID":"7a57c2d1-14df-42b5-8ec5-49122373b6ce","Type":"ContainerDied","Data":"b95860fc0cab10cc7100fc30306d9376a1368e0a8f24def3b0b13f01d0d9be4b"}
Jul 15 16:52:09.822958 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.822635    2575 scope.go:117] "RemoveContainer" containerID="e30fe2f812b3d025b7b531773d256db3dcac84f22354eb578c5c8f1804b632c8"
Jul 15 16:52:09.842962 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.842932    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:52:09.846877 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:09.846846    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4498"]
Jul 15 16:52:10.023277 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:10.023241    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a57c2d1-14df-42b5-8ec5-49122373b6ce" path="/var/lib/kubelet/pods/7a57c2d1-14df-42b5-8ec5-49122373b6ce/volumes"
Jul 15 16:52:13.570365 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:13.570336    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:13.669088 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:13.669057    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:14.042244 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042206    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"]
Jul 15 16:52:14.042534 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042523    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a57c2d1-14df-42b5-8ec5-49122373b6ce" containerName="limitador"
Jul 15 16:52:14.042577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042536    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a57c2d1-14df-42b5-8ec5-49122373b6ce" containerName="limitador"
Jul 15 16:52:14.042577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042561    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc740a1-1192-4d90-838e-5cc1c4ed91df" containerName="authorino"
Jul 15 16:52:14.042577 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042567    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc740a1-1192-4d90-838e-5cc1c4ed91df" containerName="authorino"
Jul 15 16:52:14.042670 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042613    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc740a1-1192-4d90-838e-5cc1c4ed91df" containerName="authorino"
Jul 15 16:52:14.042670 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.042620    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a57c2d1-14df-42b5-8ec5-49122373b6ce" containerName="limitador"
Jul 15 16:52:14.047474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.047445    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.050152 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.050122    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 16:52:14.050322 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.050181    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-79zl2\""
Jul 15 16:52:14.051171 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.051154    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 16:52:14.051220 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.051209    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 16:52:14.055527 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.055504    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"]
Jul 15 16:52:14.072271 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.072240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:14.123998 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.123959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-924xv\" (UniqueName: \"kubernetes.io/projected/7eb17695-ef1f-48ed-aedc-be516915bfb6-kube-api-access-924xv\") pod \"postgres-69fb4594cf-k67hn\" (UID: \"7eb17695-ef1f-48ed-aedc-be516915bfb6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.124506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.124235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7eb17695-ef1f-48ed-aedc-be516915bfb6-data\") pod \"postgres-69fb4594cf-k67hn\" (UID: \"7eb17695-ef1f-48ed-aedc-be516915bfb6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.225140 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.225043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7eb17695-ef1f-48ed-aedc-be516915bfb6-data\") pod \"postgres-69fb4594cf-k67hn\" (UID: \"7eb17695-ef1f-48ed-aedc-be516915bfb6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.225140 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.225083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-924xv\" (UniqueName: \"kubernetes.io/projected/7eb17695-ef1f-48ed-aedc-be516915bfb6-kube-api-access-924xv\") pod \"postgres-69fb4594cf-k67hn\" (UID: \"7eb17695-ef1f-48ed-aedc-be516915bfb6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.225429 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.225407    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7eb17695-ef1f-48ed-aedc-be516915bfb6-data\") pod \"postgres-69fb4594cf-k67hn\" (UID: \"7eb17695-ef1f-48ed-aedc-be516915bfb6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.234066 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.234042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-924xv\" (UniqueName: \"kubernetes.io/projected/7eb17695-ef1f-48ed-aedc-be516915bfb6-kube-api-access-924xv\") pod \"postgres-69fb4594cf-k67hn\" (UID: \"7eb17695-ef1f-48ed-aedc-be516915bfb6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.358482 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.358441    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:14.505087 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.505008    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"]
Jul 15 16:52:14.508345 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:52:14.508318    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb17695_ef1f_48ed_aedc_be516915bfb6.slice/crio-ac75002ad99a115fa54b79b0fac4b05730185b30dff9b3d9577d64a561e6aacd WatchSource:0}: Error finding container ac75002ad99a115fa54b79b0fac4b05730185b30dff9b3d9577d64a561e6aacd: Status 404 returned error can't find the container with id ac75002ad99a115fa54b79b0fac4b05730185b30dff9b3d9577d64a561e6aacd
Jul 15 16:52:14.848635 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:14.848596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn" event={"ID":"7eb17695-ef1f-48ed-aedc-be516915bfb6","Type":"ContainerStarted","Data":"ac75002ad99a115fa54b79b0fac4b05730185b30dff9b3d9577d64a561e6aacd"}
Jul 15 16:52:20.879882 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:20.879845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn" event={"ID":"7eb17695-ef1f-48ed-aedc-be516915bfb6","Type":"ContainerStarted","Data":"38739efd499085fb370c141bdd1b8f1ba96efa01adf79ca9d619d6d10c1b2e97"}
Jul 15 16:52:20.880318 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:20.879929    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:20.896932 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:20.896873    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn" podStartSLOduration=1.348763991 podStartE2EDuration="6.896857777s" totalImagesPullingTime="5.548093786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:52:20.895724894 +0000 UTC m=+727.465600203" watchObservedRunningTime="2026-07-15 16:52:20.896857777 +0000 UTC m=+727.466733072"
Jul 15 16:52:26.915253 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:26.915221    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-k67hn"
Jul 15 16:52:27.218592 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.218502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:27.435777 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.435741    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kpl9b"]
Jul 15 16:52:27.486456 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.486369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:27.510752 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.510721    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kpl9b"]
Jul 15 16:52:27.510853 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.510841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:27.551175 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.551139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81-kube-api-access-mxwtg\") pod \"authorino-5d4b67c446-kpl9b\" (UID: \"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81\") " pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:27.652475 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.652435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81-kube-api-access-mxwtg\") pod \"authorino-5d4b67c446-kpl9b\" (UID: \"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81\") " pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:27.660643 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.660610    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81-kube-api-access-mxwtg\") pod \"authorino-5d4b67c446-kpl9b\" (UID: \"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81\") " pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:27.668579 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.668552    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kpl9b"]
Jul 15 16:52:27.668842 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.668829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:27.695764 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.695720    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-795c467755-72d7q"]
Jul 15 16:52:27.717930 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.717878    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795c467755-72d7q"]
Jul 15 16:52:27.718102 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.718011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:27.754079 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.754039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2fr\" (UniqueName: \"kubernetes.io/projected/4100adeb-7be6-43c4-9993-32cdab3be8f8-kube-api-access-4s2fr\") pod \"authorino-795c467755-72d7q\" (UID: \"4100adeb-7be6-43c4-9993-32cdab3be8f8\") " pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:27.826581 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.826555    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kpl9b"]
Jul 15 16:52:27.829193 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:52:27.829164    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb921fcf2_e4f9_416f_a1ac_43e63e6bbf81.slice/crio-5e37f553bd248cb022cbcf2e98a19be75909ee511c628a448bf8fb7c002b2805 WatchSource:0}: Error finding container 5e37f553bd248cb022cbcf2e98a19be75909ee511c628a448bf8fb7c002b2805: Status 404 returned error can't find the container with id 5e37f553bd248cb022cbcf2e98a19be75909ee511c628a448bf8fb7c002b2805
Jul 15 16:52:27.854737 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.854702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2fr\" (UniqueName: \"kubernetes.io/projected/4100adeb-7be6-43c4-9993-32cdab3be8f8-kube-api-access-4s2fr\") pod \"authorino-795c467755-72d7q\" (UID: \"4100adeb-7be6-43c4-9993-32cdab3be8f8\") " pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:27.864001 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.863970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2fr\" (UniqueName: \"kubernetes.io/projected/4100adeb-7be6-43c4-9993-32cdab3be8f8-kube-api-access-4s2fr\") pod \"authorino-795c467755-72d7q\" (UID: \"4100adeb-7be6-43c4-9993-32cdab3be8f8\") " pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:27.881727 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.881693    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795c467755-72d7q"]
Jul 15 16:52:27.882006 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.881991    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:27.910530 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.910501    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-757f8d955f-7rmjw"]
Jul 15 16:52:27.936899 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.936862    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757f8d955f-7rmjw"]
Jul 15 16:52:27.936899 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.936903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kpl9b" event={"ID":"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81","Type":"ContainerStarted","Data":"5e37f553bd248cb022cbcf2e98a19be75909ee511c628a448bf8fb7c002b2805"}
Jul 15 16:52:27.937426 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.936999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:27.939666 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.939647    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 16:52:27.956182 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.956133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07666f61-2a1f-49d8-accb-15af733e173e-tls-cert\") pod \"authorino-757f8d955f-7rmjw\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") " pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:27.956353 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:27.956261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lprrh\" (UniqueName: \"kubernetes.io/projected/07666f61-2a1f-49d8-accb-15af733e173e-kube-api-access-lprrh\") pod \"authorino-757f8d955f-7rmjw\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") " pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:28.040718 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.040694    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795c467755-72d7q"]
Jul 15 16:52:28.043115 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:52:28.043082    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4100adeb_7be6_43c4_9993_32cdab3be8f8.slice/crio-985ee3f160bd030bb56660e0a1ff3ea2e26311413320cfa18d4d777e96bd24db WatchSource:0}: Error finding container 985ee3f160bd030bb56660e0a1ff3ea2e26311413320cfa18d4d777e96bd24db: Status 404 returned error can't find the container with id 985ee3f160bd030bb56660e0a1ff3ea2e26311413320cfa18d4d777e96bd24db
Jul 15 16:52:28.057506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.057473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lprrh\" (UniqueName: \"kubernetes.io/projected/07666f61-2a1f-49d8-accb-15af733e173e-kube-api-access-lprrh\") pod \"authorino-757f8d955f-7rmjw\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") " pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:28.057632 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.057578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07666f61-2a1f-49d8-accb-15af733e173e-tls-cert\") pod \"authorino-757f8d955f-7rmjw\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") " pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:28.060110 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.060089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07666f61-2a1f-49d8-accb-15af733e173e-tls-cert\") pod \"authorino-757f8d955f-7rmjw\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") " pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:28.065179 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.065154    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lprrh\" (UniqueName: \"kubernetes.io/projected/07666f61-2a1f-49d8-accb-15af733e173e-kube-api-access-lprrh\") pod \"authorino-757f8d955f-7rmjw\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") " pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:28.248602 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.248504    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:52:28.436127 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.436080    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757f8d955f-7rmjw"]
Jul 15 16:52:28.438664 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:52:28.438642    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07666f61_2a1f_49d8_accb_15af733e173e.slice/crio-90353343d51f6af7a75a5d6aa8e2380a992c58406f384766465bf2d6cdfac9f6 WatchSource:0}: Error finding container 90353343d51f6af7a75a5d6aa8e2380a992c58406f384766465bf2d6cdfac9f6: Status 404 returned error can't find the container with id 90353343d51f6af7a75a5d6aa8e2380a992c58406f384766465bf2d6cdfac9f6
Jul 15 16:52:28.918716 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.918667    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kpl9b" event={"ID":"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81","Type":"ContainerStarted","Data":"94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78"}
Jul 15 16:52:28.919011 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.918729    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kpl9b" podUID="b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" containerName="authorino" containerID="cri-o://94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78" gracePeriod=30
Jul 15 16:52:28.920658 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.920631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c467755-72d7q" event={"ID":"4100adeb-7be6-43c4-9993-32cdab3be8f8","Type":"ContainerStarted","Data":"932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f"}
Jul 15 16:52:28.920818 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.920675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c467755-72d7q" event={"ID":"4100adeb-7be6-43c4-9993-32cdab3be8f8","Type":"ContainerStarted","Data":"985ee3f160bd030bb56660e0a1ff3ea2e26311413320cfa18d4d777e96bd24db"}
Jul 15 16:52:28.920818 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.920682    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-795c467755-72d7q" podUID="4100adeb-7be6-43c4-9993-32cdab3be8f8" containerName="authorino" containerID="cri-o://932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f" gracePeriod=30
Jul 15 16:52:28.923400 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.922809    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757f8d955f-7rmjw" event={"ID":"07666f61-2a1f-49d8-accb-15af733e173e","Type":"ContainerStarted","Data":"08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78"}
Jul 15 16:52:28.923400 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.922852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757f8d955f-7rmjw" event={"ID":"07666f61-2a1f-49d8-accb-15af733e173e","Type":"ContainerStarted","Data":"90353343d51f6af7a75a5d6aa8e2380a992c58406f384766465bf2d6cdfac9f6"}
Jul 15 16:52:28.927207 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:52:28.927178    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb921fcf2_e4f9_416f_a1ac_43e63e6bbf81.slice/crio-94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 16:52:28.935946 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.935856    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kpl9b" podStartSLOduration=1.133498197 podStartE2EDuration="1.935833853s" totalImagesPullingTime="802.335656ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:52:28.933102562 +0000 UTC m=+735.502977859" watchObservedRunningTime="2026-07-15 16:52:28.935833853 +0000 UTC m=+735.505709151"
Jul 15 16:52:28.954221 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.954159    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-795c467755-72d7q" podStartSLOduration=1.44464642 podStartE2EDuration="1.954140517s" totalImagesPullingTime="509.494097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:52:28.952806085 +0000 UTC m=+735.522681378" watchObservedRunningTime="2026-07-15 16:52:28.954140517 +0000 UTC m=+735.524015812"
Jul 15 16:52:28.979502 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:28.979448    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-757f8d955f-7rmjw" podStartSLOduration=1.62692478 podStartE2EDuration="1.979430988s" totalImagesPullingTime="352.506208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:52:28.978062558 +0000 UTC m=+735.547937855" watchObservedRunningTime="2026-07-15 16:52:28.979430988 +0000 UTC m=+735.549306284"
Jul 15 16:52:29.004278 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.004245    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thtpn"]
Jul 15 16:52:29.004462 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.004433    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-thtpn" podUID="5715df24-149f-4ff7-8614-56c44dde5ef6" containerName="authorino" containerID="cri-o://2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4" gracePeriod=30
Jul 15 16:52:29.253649 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.253613    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:29.291087 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.291058    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:29.297770 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.297744    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:52:29.370337 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.370238    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81-kube-api-access-mxwtg\") pod \"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81\" (UID: \"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81\") "
Jul 15 16:52:29.370337 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.370275    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s2fr\" (UniqueName: \"kubernetes.io/projected/4100adeb-7be6-43c4-9993-32cdab3be8f8-kube-api-access-4s2fr\") pod \"4100adeb-7be6-43c4-9993-32cdab3be8f8\" (UID: \"4100adeb-7be6-43c4-9993-32cdab3be8f8\") "
Jul 15 16:52:29.370337 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.370306    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv72t\" (UniqueName: \"kubernetes.io/projected/5715df24-149f-4ff7-8614-56c44dde5ef6-kube-api-access-zv72t\") pod \"5715df24-149f-4ff7-8614-56c44dde5ef6\" (UID: \"5715df24-149f-4ff7-8614-56c44dde5ef6\") "
Jul 15 16:52:29.372318 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.372282    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4100adeb-7be6-43c4-9993-32cdab3be8f8-kube-api-access-4s2fr" (OuterVolumeSpecName: "kube-api-access-4s2fr") pod "4100adeb-7be6-43c4-9993-32cdab3be8f8" (UID: "4100adeb-7be6-43c4-9993-32cdab3be8f8"). InnerVolumeSpecName "kube-api-access-4s2fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:52:29.372859 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.372832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5715df24-149f-4ff7-8614-56c44dde5ef6-kube-api-access-zv72t" (OuterVolumeSpecName: "kube-api-access-zv72t") pod "5715df24-149f-4ff7-8614-56c44dde5ef6" (UID: "5715df24-149f-4ff7-8614-56c44dde5ef6"). InnerVolumeSpecName "kube-api-access-zv72t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:52:29.372926 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.372832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81-kube-api-access-mxwtg" (OuterVolumeSpecName: "kube-api-access-mxwtg") pod "b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" (UID: "b921fcf2-e4f9-416f-a1ac-43e63e6bbf81"). InnerVolumeSpecName "kube-api-access-mxwtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:52:29.471124 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.471090    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81-kube-api-access-mxwtg\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:52:29.471124 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.471122    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s2fr\" (UniqueName: \"kubernetes.io/projected/4100adeb-7be6-43c4-9993-32cdab3be8f8-kube-api-access-4s2fr\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:52:29.471124 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.471132    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv72t\" (UniqueName: \"kubernetes.io/projected/5715df24-149f-4ff7-8614-56c44dde5ef6-kube-api-access-zv72t\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:52:29.928150 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.928056    2575 generic.go:356] "Generic (PLEG): container finished" podID="5715df24-149f-4ff7-8614-56c44dde5ef6" containerID="2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4" exitCode=0
Jul 15 16:52:29.928150 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.928104    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-thtpn"
Jul 15 16:52:29.928389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.928141    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thtpn" event={"ID":"5715df24-149f-4ff7-8614-56c44dde5ef6","Type":"ContainerDied","Data":"2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4"}
Jul 15 16:52:29.928389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.928189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-thtpn" event={"ID":"5715df24-149f-4ff7-8614-56c44dde5ef6","Type":"ContainerDied","Data":"282f11439bc1825b25976cf52e9fced023a549f57ffa5505d3dc001ca2d8f8d4"}
Jul 15 16:52:29.928389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.928209    2575 scope.go:117] "RemoveContainer" containerID="2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4"
Jul 15 16:52:29.929591 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.929496    2575 generic.go:356] "Generic (PLEG): container finished" podID="b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" containerID="94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78" exitCode=0
Jul 15 16:52:29.929591 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.929536    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kpl9b"
Jul 15 16:52:29.929706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.929583    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kpl9b" event={"ID":"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81","Type":"ContainerDied","Data":"94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78"}
Jul 15 16:52:29.929706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.929624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kpl9b" event={"ID":"b921fcf2-e4f9-416f-a1ac-43e63e6bbf81","Type":"ContainerDied","Data":"5e37f553bd248cb022cbcf2e98a19be75909ee511c628a448bf8fb7c002b2805"}
Jul 15 16:52:29.931004 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.930978    2575 generic.go:356] "Generic (PLEG): container finished" podID="4100adeb-7be6-43c4-9993-32cdab3be8f8" containerID="932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f" exitCode=0
Jul 15 16:52:29.931115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.931024    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795c467755-72d7q"
Jul 15 16:52:29.931115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.931054    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c467755-72d7q" event={"ID":"4100adeb-7be6-43c4-9993-32cdab3be8f8","Type":"ContainerDied","Data":"932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f"}
Jul 15 16:52:29.931115 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.931084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795c467755-72d7q" event={"ID":"4100adeb-7be6-43c4-9993-32cdab3be8f8","Type":"ContainerDied","Data":"985ee3f160bd030bb56660e0a1ff3ea2e26311413320cfa18d4d777e96bd24db"}
Jul 15 16:52:29.938389 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.938241    2575 scope.go:117] "RemoveContainer" containerID="2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4"
Jul 15 16:52:29.938638 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:52:29.938600    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4\": container with ID starting with 2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4 not found: ID does not exist" containerID="2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4"
Jul 15 16:52:29.938745 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.938648    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4"} err="failed to get container status \"2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4\": rpc error: code = NotFound desc = could not find container \"2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4\": container with ID starting with 2d3834896ed8cc89fe5791361ca827bf28f806f5a3fe69199c561ff0225a2ab4 not found: ID does not exist"
Jul 15 16:52:29.938745 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.938674    2575 scope.go:117] "RemoveContainer" containerID="94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78"
Jul 15 16:52:29.946893 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.946877    2575 scope.go:117] "RemoveContainer" containerID="94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78"
Jul 15 16:52:29.947170 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:52:29.947149    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78\": container with ID starting with 94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78 not found: ID does not exist" containerID="94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78"
Jul 15 16:52:29.947264 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.947179    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78"} err="failed to get container status \"94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78\": rpc error: code = NotFound desc = could not find container \"94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78\": container with ID starting with 94a218990281fb04605653b41ff30adbfc64b3284cc54a621ec9bad581103e78 not found: ID does not exist"
Jul 15 16:52:29.947264 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.947195    2575 scope.go:117] "RemoveContainer" containerID="932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f"
Jul 15 16:52:29.953421 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.953393    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thtpn"]
Jul 15 16:52:29.955664 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.955646    2575 scope.go:117] "RemoveContainer" containerID="932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f"
Jul 15 16:52:29.956080 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:52:29.956061    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f\": container with ID starting with 932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f not found: ID does not exist" containerID="932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f"
Jul 15 16:52:29.956132 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.956089    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f"} err="failed to get container status \"932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f\": rpc error: code = NotFound desc = could not find container \"932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f\": container with ID starting with 932fce0c80a017b3ee3b7d18559f03addd3b620473617a65b5c519438b56950f not found: ID does not exist"
Jul 15 16:52:29.956772 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.956756    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-thtpn"]
Jul 15 16:52:29.966841 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.966817    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795c467755-72d7q"]
Jul 15 16:52:29.977574 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.977544    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-795c467755-72d7q"]
Jul 15 16:52:29.987341 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.987308    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kpl9b"]
Jul 15 16:52:29.990987 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:29.990963    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kpl9b"]
Jul 15 16:52:30.023295 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:30.023265    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4100adeb-7be6-43c4-9993-32cdab3be8f8" path="/var/lib/kubelet/pods/4100adeb-7be6-43c4-9993-32cdab3be8f8/volumes"
Jul 15 16:52:30.023603 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:30.023591    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5715df24-149f-4ff7-8614-56c44dde5ef6" path="/var/lib/kubelet/pods/5715df24-149f-4ff7-8614-56c44dde5ef6/volumes"
Jul 15 16:52:30.023910 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:30.023897    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" path="/var/lib/kubelet/pods/b921fcf2-e4f9-416f-a1ac-43e63e6bbf81/volumes"
Jul 15 16:52:33.634283 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:33.634239    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:33.728297 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:33.728259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:33.781950 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:33.781920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:36.966101 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:36.966074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:52:37.064933 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:52:37.064900    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:00.479762 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:00.479727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:08.437247 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:08.437205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:08.534114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:08.534078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:08.924311 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:08.924279    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:09.442599 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.442568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:09.524382 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.524349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:09.603187 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.603151    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:09.612038 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612005    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"]
Jul 15 16:53:09.612395 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612376    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" containerName="authorino"
Jul 15 16:53:09.612395 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612394    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612417    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5715df24-149f-4ff7-8614-56c44dde5ef6" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612426    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5715df24-149f-4ff7-8614-56c44dde5ef6" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612449    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4100adeb-7be6-43c4-9993-32cdab3be8f8" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612458    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4100adeb-7be6-43c4-9993-32cdab3be8f8" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612529    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b921fcf2-e4f9-416f-a1ac-43e63e6bbf81" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612548    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4100adeb-7be6-43c4-9993-32cdab3be8f8" containerName="authorino"
Jul 15 16:53:09.612565 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.612558    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5715df24-149f-4ff7-8614-56c44dde5ef6" containerName="authorino"
Jul 15 16:53:09.615606 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.615583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.617996 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.617971    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 16:53:09.618121 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.618019    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5jb5v\""
Jul 15 16:53:09.625946 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.625917    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"]
Jul 15 16:53:09.626323 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.626303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwb9c\" (UniqueName: \"kubernetes.io/projected/c95ce879-f3d7-4075-b981-25fbf98bb83c-kube-api-access-bwb9c\") pod \"payload-processing-f9b8d9b9b-6jjcs\" (UID: \"c95ce879-f3d7-4075-b981-25fbf98bb83c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.626406 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.626362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c95ce879-f3d7-4075-b981-25fbf98bb83c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-6jjcs\" (UID: \"c95ce879-f3d7-4075-b981-25fbf98bb83c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.727661 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.727574    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwb9c\" (UniqueName: \"kubernetes.io/projected/c95ce879-f3d7-4075-b981-25fbf98bb83c-kube-api-access-bwb9c\") pod \"payload-processing-f9b8d9b9b-6jjcs\" (UID: \"c95ce879-f3d7-4075-b981-25fbf98bb83c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.727832 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.727658    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c95ce879-f3d7-4075-b981-25fbf98bb83c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-6jjcs\" (UID: \"c95ce879-f3d7-4075-b981-25fbf98bb83c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.728412 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.728391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c95ce879-f3d7-4075-b981-25fbf98bb83c-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-6jjcs\" (UID: \"c95ce879-f3d7-4075-b981-25fbf98bb83c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.737807 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.737766    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwb9c\" (UniqueName: \"kubernetes.io/projected/c95ce879-f3d7-4075-b981-25fbf98bb83c-kube-api-access-bwb9c\") pod \"payload-processing-f9b8d9b9b-6jjcs\" (UID: \"c95ce879-f3d7-4075-b981-25fbf98bb83c\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:09.928062 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:09.928007    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:10.069093 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:10.069066    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"]
Jul 15 16:53:10.071245 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:53:10.071217    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95ce879_f3d7_4075_b981_25fbf98bb83c.slice/crio-dc90421aebe364064b1fba94db6364a3895eefce7c142c0c07d621a759d93eca WatchSource:0}: Error finding container dc90421aebe364064b1fba94db6364a3895eefce7c142c0c07d621a759d93eca: Status 404 returned error can't find the container with id dc90421aebe364064b1fba94db6364a3895eefce7c142c0c07d621a759d93eca
Jul 15 16:53:10.104483 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:10.104448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs" event={"ID":"c95ce879-f3d7-4075-b981-25fbf98bb83c","Type":"ContainerStarted","Data":"dc90421aebe364064b1fba94db6364a3895eefce7c142c0c07d621a759d93eca"}
Jul 15 16:53:12.117510 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:12.117467    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs" event={"ID":"c95ce879-f3d7-4075-b981-25fbf98bb83c","Type":"ContainerStarted","Data":"98c792a4ac9362b7f7aa5a1c798008c676a9c948478df1fd76187140962d2ab5"}
Jul 15 16:53:12.117948 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:12.117554    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:12.146340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:12.146278    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs" podStartSLOduration=1.7581989180000002 podStartE2EDuration="3.1462533s" totalImagesPullingTime="1.388054382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:53:12.144538155 +0000 UTC m=+778.714413453" watchObservedRunningTime="2026-07-15 16:53:12.1462533 +0000 UTC m=+778.716128597"
Jul 15 16:53:19.596636 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:19.596597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:23.123485 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:23.123452    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-6jjcs"
Jul 15 16:53:23.413888 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:23.413772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:32.648185 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.648143    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"]
Jul 15 16:53:32.652918 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.652893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.656489 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.656463    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 16:53:32.656489 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.656479    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 16:53:32.656706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.656463    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 16:53:32.656706 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.656517    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hh5sk\""
Jul 15 16:53:32.660631 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.660608    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"]
Jul 15 16:53:32.685109 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.685073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:32.735136 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.735099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdrs\" (UniqueName: \"kubernetes.io/projected/cf200aba-ad01-4cf4-8322-00232d9e4bed-kube-api-access-vcdrs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.735136 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.735145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.735361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.735166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf200aba-ad01-4cf4-8322-00232d9e4bed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.735361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.735272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.735361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.735301    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.735361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.735323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836025 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.835993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdrs\" (UniqueName: \"kubernetes.io/projected/cf200aba-ad01-4cf4-8322-00232d9e4bed-kube-api-access-vcdrs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836246 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836246 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf200aba-ad01-4cf4-8322-00232d9e4bed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836246 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836246 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836461 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836697 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836697 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.836935 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.836909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.838997 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.838969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf200aba-ad01-4cf4-8322-00232d9e4bed-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.839101 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.839046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf200aba-ad01-4cf4-8322-00232d9e4bed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.844967 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.844931    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdrs\" (UniqueName: \"kubernetes.io/projected/cf200aba-ad01-4cf4-8322-00232d9e4bed-kube-api-access-vcdrs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8\" (UID: \"cf200aba-ad01-4cf4-8322-00232d9e4bed\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:32.965045 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:32.964927    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:33.107959 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:33.107923    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"]
Jul 15 16:53:33.108977 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:53:33.108947    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf200aba_ad01_4cf4_8322_00232d9e4bed.slice/crio-2bca7c5fd92498ebd2c870015c37de1cde1e6ba31f807d8e319ff926a537b283 WatchSource:0}: Error finding container 2bca7c5fd92498ebd2c870015c37de1cde1e6ba31f807d8e319ff926a537b283: Status 404 returned error can't find the container with id 2bca7c5fd92498ebd2c870015c37de1cde1e6ba31f807d8e319ff926a537b283
Jul 15 16:53:33.110400 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:33.110382    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 16:53:33.208864 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:33.208824    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8" event={"ID":"cf200aba-ad01-4cf4-8322-00232d9e4bed","Type":"ContainerStarted","Data":"2bca7c5fd92498ebd2c870015c37de1cde1e6ba31f807d8e319ff926a537b283"}
Jul 15 16:53:35.220661 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:35.220567    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8" event={"ID":"cf200aba-ad01-4cf4-8322-00232d9e4bed","Type":"ContainerStarted","Data":"cef36b8681c50a48db5a8529c0044c3ddb8e7fabc548a6b5f95b777cfe8d4ad2"}
Jul 15 16:53:35.240197 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:35.240143    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8" podStartSLOduration=2.041149104 podStartE2EDuration="3.240124337s" totalImagesPullingTime="1.198975233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:53:35.238555733 +0000 UTC m=+801.808431041" watchObservedRunningTime="2026-07-15 16:53:35.240124337 +0000 UTC m=+801.809999635"
Jul 15 16:53:42.965506 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:42.965463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:42.965986 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:42.965539    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:42.978266 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:42.978234    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:43.268466 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:43.268374    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8"
Jul 15 16:53:43.353096 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:43.353062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:54.036501 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.036458    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"]
Jul 15 16:53:54.039118 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.039098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.041714 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.041694    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 16:53:54.049365 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.049340    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"]
Jul 15 16:53:54.060605 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.060572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:54.133336 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.133306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.133336 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.133340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6556ebb-eb7d-4404-88df-2a5ee42ed289-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.133572 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.133368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5cl\" (UniqueName: \"kubernetes.io/projected/f6556ebb-eb7d-4404-88df-2a5ee42ed289-kube-api-access-hs5cl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.133572 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.133399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.133572 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.133468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.133572 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.133495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234475 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234675 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234675 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234831 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234831 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6556ebb-eb7d-4404-88df-2a5ee42ed289-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234913 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5cl\" (UniqueName: \"kubernetes.io/projected/f6556ebb-eb7d-4404-88df-2a5ee42ed289-kube-api-access-hs5cl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.234973 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.235015 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.234980    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.235099 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.235076    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.236654 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.236623    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6556ebb-eb7d-4404-88df-2a5ee42ed289-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.237132 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.237116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6556ebb-eb7d-4404-88df-2a5ee42ed289-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.242936 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.242917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5cl\" (UniqueName: \"kubernetes.io/projected/f6556ebb-eb7d-4404-88df-2a5ee42ed289-kube-api-access-hs5cl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rc9tn\" (UID: \"f6556ebb-eb7d-4404-88df-2a5ee42ed289\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.349159 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.349124    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:53:54.486610 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:54.486469    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"]
Jul 15 16:53:54.489234 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:53:54.489206    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6556ebb_eb7d_4404_88df_2a5ee42ed289.slice/crio-6dc6d8a42fecc5e5ee3e8c6a8c2709c76f14d41b2c7ab7b06d07ed97204c126d WatchSource:0}: Error finding container 6dc6d8a42fecc5e5ee3e8c6a8c2709c76f14d41b2c7ab7b06d07ed97204c126d: Status 404 returned error can't find the container with id 6dc6d8a42fecc5e5ee3e8c6a8c2709c76f14d41b2c7ab7b06d07ed97204c126d
Jul 15 16:53:55.319761 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:55.319724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn" event={"ID":"f6556ebb-eb7d-4404-88df-2a5ee42ed289","Type":"ContainerStarted","Data":"70122474ef924de6f3a19201a986b011418174c7c8a10b76eaa977b1258fd14e"}
Jul 15 16:53:55.320187 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:55.319781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn" event={"ID":"f6556ebb-eb7d-4404-88df-2a5ee42ed289","Type":"ContainerStarted","Data":"6dc6d8a42fecc5e5ee3e8c6a8c2709c76f14d41b2c7ab7b06d07ed97204c126d"}
Jul 15 16:53:55.338317 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:55.338256    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn" podStartSLOduration=1.128034229 podStartE2EDuration="1.338235978s" totalImagesPullingTime="210.201749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:53:55.337676723 +0000 UTC m=+821.907552019" watchObservedRunningTime="2026-07-15 16:53:55.338235978 +0000 UTC m=+821.908111274"
Jul 15 16:53:56.548031 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:56.547997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:56.648038 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:56.648005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:53:58.756190 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:53:58.756156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:54:03.655005 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:03.654970    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:54:04.349517 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:04.349478    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:54:04.349716 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:04.349641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:54:04.362494 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:04.362463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:54:05.375924 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:05.375894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rc9tn"
Jul 15 16:54:13.938232 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:13.938187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:54:58.457839 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:58.457800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:54:58.509391 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:54:58.509350    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:55:04.067839 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.067802    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7779ffdcc4-h2fzm"]
Jul 15 16:55:04.071268 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.071248    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.079084 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.079056    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7779ffdcc4-h2fzm"]
Jul 15 16:55:04.174625 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.174584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffg4v\" (UniqueName: \"kubernetes.io/projected/b016c74a-90be-439a-b576-87e5d1951ec8-kube-api-access-ffg4v\") pod \"authorino-7779ffdcc4-h2fzm\" (UID: \"b016c74a-90be-439a-b576-87e5d1951ec8\") " pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.174853 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.174692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b016c74a-90be-439a-b576-87e5d1951ec8-tls-cert\") pod \"authorino-7779ffdcc4-h2fzm\" (UID: \"b016c74a-90be-439a-b576-87e5d1951ec8\") " pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.275720 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.275685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffg4v\" (UniqueName: \"kubernetes.io/projected/b016c74a-90be-439a-b576-87e5d1951ec8-kube-api-access-ffg4v\") pod \"authorino-7779ffdcc4-h2fzm\" (UID: \"b016c74a-90be-439a-b576-87e5d1951ec8\") " pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.275945 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.275741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b016c74a-90be-439a-b576-87e5d1951ec8-tls-cert\") pod \"authorino-7779ffdcc4-h2fzm\" (UID: \"b016c74a-90be-439a-b576-87e5d1951ec8\") " pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.278255 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.278229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b016c74a-90be-439a-b576-87e5d1951ec8-tls-cert\") pod \"authorino-7779ffdcc4-h2fzm\" (UID: \"b016c74a-90be-439a-b576-87e5d1951ec8\") " pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.284087 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.284055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffg4v\" (UniqueName: \"kubernetes.io/projected/b016c74a-90be-439a-b576-87e5d1951ec8-kube-api-access-ffg4v\") pod \"authorino-7779ffdcc4-h2fzm\" (UID: \"b016c74a-90be-439a-b576-87e5d1951ec8\") " pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.402913 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.402868    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7779ffdcc4-h2fzm"
Jul 15 16:55:04.538186 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.538063    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7779ffdcc4-h2fzm"]
Jul 15 16:55:04.540498 ip-10-0-135-165 kubenswrapper[2575]: W0715 16:55:04.540469    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb016c74a_90be_439a_b576_87e5d1951ec8.slice/crio-a5d4e65da091ed9a5bf06bf549b5f6d31b18017d969cdcfe15d6e99afb5529d9 WatchSource:0}: Error finding container a5d4e65da091ed9a5bf06bf549b5f6d31b18017d969cdcfe15d6e99afb5529d9: Status 404 returned error can't find the container with id a5d4e65da091ed9a5bf06bf549b5f6d31b18017d969cdcfe15d6e99afb5529d9
Jul 15 16:55:04.638564 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:04.638526    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7779ffdcc4-h2fzm" event={"ID":"b016c74a-90be-439a-b576-87e5d1951ec8","Type":"ContainerStarted","Data":"a5d4e65da091ed9a5bf06bf549b5f6d31b18017d969cdcfe15d6e99afb5529d9"}
Jul 15 16:55:06.651586 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:06.651539    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7779ffdcc4-h2fzm" event={"ID":"b016c74a-90be-439a-b576-87e5d1951ec8","Type":"ContainerStarted","Data":"e45fbac9924c96e697a2511752e3b47fca4cf8f76d9e4882a182af52a4b67e26"}
Jul 15 16:55:06.673830 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:06.673739    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7779ffdcc4-h2fzm" podStartSLOduration=1.375630168 podStartE2EDuration="2.673712927s" totalImagesPullingTime="1.298082759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 16:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 16:55:06.67039009 +0000 UTC m=+893.240265390" watchObservedRunningTime="2026-07-15 16:55:06.673712927 +0000 UTC m=+893.243588225"
Jul 15 16:55:06.695688 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:06.695653    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-757f8d955f-7rmjw"]
Jul 15 16:55:06.695913 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:06.695875    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-757f8d955f-7rmjw" podUID="07666f61-2a1f-49d8-accb-15af733e173e" containerName="authorino" containerID="cri-o://08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78" gracePeriod=30
Jul 15 16:55:06.968277 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:06.967563    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:55:07.105664 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.105628    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lprrh\" (UniqueName: \"kubernetes.io/projected/07666f61-2a1f-49d8-accb-15af733e173e-kube-api-access-lprrh\") pod \"07666f61-2a1f-49d8-accb-15af733e173e\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") "
Jul 15 16:55:07.105899 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.105700    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07666f61-2a1f-49d8-accb-15af733e173e-tls-cert\") pod \"07666f61-2a1f-49d8-accb-15af733e173e\" (UID: \"07666f61-2a1f-49d8-accb-15af733e173e\") "
Jul 15 16:55:07.107828 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.107776    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07666f61-2a1f-49d8-accb-15af733e173e-kube-api-access-lprrh" (OuterVolumeSpecName: "kube-api-access-lprrh") pod "07666f61-2a1f-49d8-accb-15af733e173e" (UID: "07666f61-2a1f-49d8-accb-15af733e173e"). InnerVolumeSpecName "kube-api-access-lprrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 16:55:07.116809 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.116757    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07666f61-2a1f-49d8-accb-15af733e173e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "07666f61-2a1f-49d8-accb-15af733e173e" (UID: "07666f61-2a1f-49d8-accb-15af733e173e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 16:55:07.207487 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.207393    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lprrh\" (UniqueName: \"kubernetes.io/projected/07666f61-2a1f-49d8-accb-15af733e173e-kube-api-access-lprrh\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:55:07.207487 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.207429    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07666f61-2a1f-49d8-accb-15af733e173e-tls-cert\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 16:55:07.221474 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.221442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:55:07.315773 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.315729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:55:07.658340 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.658299    2575 generic.go:356] "Generic (PLEG): container finished" podID="07666f61-2a1f-49d8-accb-15af733e173e" containerID="08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78" exitCode=0
Jul 15 16:55:07.658766 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.658365    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757f8d955f-7rmjw"
Jul 15 16:55:07.658766 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.658398    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757f8d955f-7rmjw" event={"ID":"07666f61-2a1f-49d8-accb-15af733e173e","Type":"ContainerDied","Data":"08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78"}
Jul 15 16:55:07.658766 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.658453    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757f8d955f-7rmjw" event={"ID":"07666f61-2a1f-49d8-accb-15af733e173e","Type":"ContainerDied","Data":"90353343d51f6af7a75a5d6aa8e2380a992c58406f384766465bf2d6cdfac9f6"}
Jul 15 16:55:07.658766 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.658481    2575 scope.go:117] "RemoveContainer" containerID="08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78"
Jul 15 16:55:07.668304 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.668284    2575 scope.go:117] "RemoveContainer" containerID="08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78"
Jul 15 16:55:07.668664 ip-10-0-135-165 kubenswrapper[2575]: E0715 16:55:07.668646    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78\": container with ID starting with 08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78 not found: ID does not exist" containerID="08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78"
Jul 15 16:55:07.668716 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.668674    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78"} err="failed to get container status \"08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78\": rpc error: code = NotFound desc = could not find container \"08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78\": container with ID starting with 08b27e037b7c9a9133337aceb43d69c73de26311ed77596ae6688fdfe98ffb78 not found: ID does not exist"
Jul 15 16:55:07.682050 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.682012    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-757f8d955f-7rmjw"]
Jul 15 16:55:07.685535 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:07.685505    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-757f8d955f-7rmjw"]
Jul 15 16:55:08.026944 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:08.025075    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07666f61-2a1f-49d8-accb-15af733e173e" path="/var/lib/kubelet/pods/07666f61-2a1f-49d8-accb-15af733e173e/volumes"
Jul 15 16:55:08.366976 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:08.366940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:55:08.476361 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:08.476325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:55:09.974070 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:09.974031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:55:13.901640 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:13.901613    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:55:13.902779 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:55:13.902745    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 16:56:19.238870 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:56:19.238831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:56:21.174929 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:56:21.174889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:01.872847 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:01.872767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:01.972114 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:01.972074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:02.106075 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:02.106040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:07.791087 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:07.791047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:07.853290 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:07.853256    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:07.940845 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:07.940780    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:08.041175 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:08.041095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:08.154768 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:08.154732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:13.908300 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:13.908268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:57:14.052807 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:57:14.052760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:58:28.022448 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:58:28.022351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:58:29.747407 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:58:29.747368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:58:46.810188 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:58:46.810146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:58:48.221990 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:58:48.221937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 16:59:08.647849 ip-10-0-135-165 kubenswrapper[2575]: I0715 16:59:08.647810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:00:13.934044 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:00:13.933967    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:00:13.934044 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:00:13.933969    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:00:44.825223 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:00:44.825178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:00:44.879519 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:00:44.879479    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:02:47.286587 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:02:47.286484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:04:33.708634 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:04:33.708588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:05:13.963893 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:05:13.963865    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:05:13.965283 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:05:13.965244    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:07:39.203588 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:07:39.203552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:07:39.617860 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:07:39.617829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:00.253708 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:00.253675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:04.111967 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:04.111932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:12.396986 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:12.396953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:17.511192 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:17.511137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:20.562944 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:20.562910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:20.663040 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:20.662992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:21.042604 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:21.042551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:26.827492 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:26.827454    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:26.894441 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:26.894391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:27.061569 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:27.061507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:27.161942 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:27.161851    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:28.139000 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:28.138962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:28.226246 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:28.226204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:28.416883 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:28.416803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:28.552517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:28.552484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:28.899261 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:28.899227    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:29.002418 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:29.002382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:30.857529 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:30.857498    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:33.201744 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.201706    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"]
Jul 15 17:08:33.202286 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.202265    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07666f61-2a1f-49d8-accb-15af733e173e" containerName="authorino"
Jul 15 17:08:33.202332 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.202292    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="07666f61-2a1f-49d8-accb-15af733e173e" containerName="authorino"
Jul 15 17:08:33.202410 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.202398    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="07666f61-2a1f-49d8-accb-15af733e173e" containerName="authorino"
Jul 15 17:08:33.205511 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.205494    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:33.207971 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.207947    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\""
Jul 15 17:08:33.213017 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.212616    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"]
Jul 15 17:08:33.311210 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.311174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a246884f-7218-4c8c-9f6f-dbc7a26814a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7bb30196-s78rp\" (UID: \"a246884f-7218-4c8c-9f6f-dbc7a26814a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:33.412131 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.412089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a246884f-7218-4c8c-9f6f-dbc7a26814a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7bb30196-s78rp\" (UID: \"a246884f-7218-4c8c-9f6f-dbc7a26814a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:33.412747 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.412725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a246884f-7218-4c8c-9f6f-dbc7a26814a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7bb30196-s78rp\" (UID: \"a246884f-7218-4c8c-9f6f-dbc7a26814a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:33.517291 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.517197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:33.649531 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.649504    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"]
Jul 15 17:08:33.652157 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:08:33.652123    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda246884f_7218_4c8c_9f6f_dbc7a26814a3.slice/crio-c3a9698622ac5d43726b9eb6f9027936a3b794d5889976654b82d854cb85d872 WatchSource:0}: Error finding container c3a9698622ac5d43726b9eb6f9027936a3b794d5889976654b82d854cb85d872: Status 404 returned error can't find the container with id c3a9698622ac5d43726b9eb6f9027936a3b794d5889976654b82d854cb85d872
Jul 15 17:08:33.654450 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:33.654433    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:08:34.316871 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:34.316826    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp" event={"ID":"a246884f-7218-4c8c-9f6f-dbc7a26814a3","Type":"ContainerStarted","Data":"c3a9698622ac5d43726b9eb6f9027936a3b794d5889976654b82d854cb85d872"}
Jul 15 17:08:38.338112 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:38.338075    2575 generic.go:356] "Generic (PLEG): container finished" podID="a246884f-7218-4c8c-9f6f-dbc7a26814a3" containerID="fa46b2a2e9a790ffbcf2f1be8a81eaff6532fdcdccee9e9089c2d48cef85f951" exitCode=0
Jul 15 17:08:38.338506 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:38.338160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp" event={"ID":"a246884f-7218-4c8c-9f6f-dbc7a26814a3","Type":"ContainerDied","Data":"fa46b2a2e9a790ffbcf2f1be8a81eaff6532fdcdccee9e9089c2d48cef85f951"}
Jul 15 17:08:39.472910 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:39.472880    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:39.571661 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:39.571624    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a246884f-7218-4c8c-9f6f-dbc7a26814a3-maas-api-service-ca\") pod \"a246884f-7218-4c8c-9f6f-dbc7a26814a3\" (UID: \"a246884f-7218-4c8c-9f6f-dbc7a26814a3\") "
Jul 15 17:08:39.572044 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:39.572018    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a246884f-7218-4c8c-9f6f-dbc7a26814a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a246884f-7218-4c8c-9f6f-dbc7a26814a3" (UID: "a246884f-7218-4c8c-9f6f-dbc7a26814a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:08:39.672751 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:39.672655    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a246884f-7218-4c8c-9f6f-dbc7a26814a3-maas-api-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:08:40.348606 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:40.348581    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp"
Jul 15 17:08:40.348814 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:40.348612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7bb30196-s78rp" event={"ID":"a246884f-7218-4c8c-9f6f-dbc7a26814a3","Type":"ContainerDied","Data":"c3a9698622ac5d43726b9eb6f9027936a3b794d5889976654b82d854cb85d872"}
Jul 15 17:08:40.348814 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:40.348671    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3a9698622ac5d43726b9eb6f9027936a3b794d5889976654b82d854cb85d872"
Jul 15 17:08:43.616580 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:43.616544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:48.284770 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:48.284732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:53.995991 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:53.995962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:54.062578 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:54.062543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:58.475615 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:58.475568    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:58.834185 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:58.834146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:58.978982 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:58.978948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:08:59.149877 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:08:59.149758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:00.274992 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:00.274958    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:00.500991 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:00.500954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:00.937697 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:00.937652    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:01.038663 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:01.038606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:01.190160 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:01.190061    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:04.790727 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.790690    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"]
Jul 15 17:09:04.791156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.791042    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a246884f-7218-4c8c-9f6f-dbc7a26814a3" containerName="revoke-keys"
Jul 15 17:09:04.791156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.791054    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a246884f-7218-4c8c-9f6f-dbc7a26814a3" containerName="revoke-keys"
Jul 15 17:09:04.791156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.791123    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a246884f-7218-4c8c-9f6f-dbc7a26814a3" containerName="revoke-keys"
Jul 15 17:09:04.794129 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.794111    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:04.796575 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.796556    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\""
Jul 15 17:09:04.801274 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.801211    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"]
Jul 15 17:09:04.903027 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:04.902982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d642a7a-f5b5-4359-849c-a839bf052438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv\" (UID: \"3d642a7a-f5b5-4359-849c-a839bf052438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:05.004409 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.004353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d642a7a-f5b5-4359-849c-a839bf052438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv\" (UID: \"3d642a7a-f5b5-4359-849c-a839bf052438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:05.005125 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.005097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d642a7a-f5b5-4359-849c-a839bf052438-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv\" (UID: \"3d642a7a-f5b5-4359-849c-a839bf052438\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:05.097519 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.097484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:05.105941 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.105913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:05.198571 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.198469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:05.246447 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.246424    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"]
Jul 15 17:09:05.249003 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:09:05.248974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d642a7a_f5b5_4359_849c_a839bf052438.slice/crio-67031991a57bb59ee1a498c689f0164d9066d9f2de8ae83a5269c229c5193b07 WatchSource:0}: Error finding container 67031991a57bb59ee1a498c689f0164d9066d9f2de8ae83a5269c229c5193b07: Status 404 returned error can't find the container with id 67031991a57bb59ee1a498c689f0164d9066d9f2de8ae83a5269c229c5193b07
Jul 15 17:09:05.458853 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:05.458817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" event={"ID":"3d642a7a-f5b5-4359-849c-a839bf052438","Type":"ContainerStarted","Data":"67031991a57bb59ee1a498c689f0164d9066d9f2de8ae83a5269c229c5193b07"}
Jul 15 17:09:06.465188 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:06.465148    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d642a7a-f5b5-4359-849c-a839bf052438" containerID="af667fcf0f484e2365b271780835ee7bde40fa85979283fecb1e089a410af10e" exitCode=7
Jul 15 17:09:06.465625 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:06.465237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" event={"ID":"3d642a7a-f5b5-4359-849c-a839bf052438","Type":"ContainerDied","Data":"af667fcf0f484e2365b271780835ee7bde40fa85979283fecb1e089a410af10e"}
Jul 15 17:09:06.465625 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:06.465423    2575 scope.go:117] "RemoveContainer" containerID="af667fcf0f484e2365b271780835ee7bde40fa85979283fecb1e089a410af10e"
Jul 15 17:09:07.471503 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:07.471406    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d642a7a-f5b5-4359-849c-a839bf052438" containerID="24868954df03fff16dbc92538ece38e9881b732fe6b663dee86e6976726fdcd0" exitCode=7
Jul 15 17:09:07.471503 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:07.471471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" event={"ID":"3d642a7a-f5b5-4359-849c-a839bf052438","Type":"ContainerDied","Data":"24868954df03fff16dbc92538ece38e9881b732fe6b663dee86e6976726fdcd0"}
Jul 15 17:09:07.471982 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:07.471567    2575 scope.go:117] "RemoveContainer" containerID="af667fcf0f484e2365b271780835ee7bde40fa85979283fecb1e089a410af10e"
Jul 15 17:09:07.471982 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:07.471847    2575 scope.go:117] "RemoveContainer" containerID="24868954df03fff16dbc92538ece38e9881b732fe6b663dee86e6976726fdcd0"
Jul 15 17:09:07.472093 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:09:07.472077    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv_odh-ai-gateway-infra(3d642a7a-f5b5-4359-849c-a839bf052438)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" podUID="3d642a7a-f5b5-4359-849c-a839bf052438"
Jul 15 17:09:08.478264 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:08.478232    2575 scope.go:117] "RemoveContainer" containerID="24868954df03fff16dbc92538ece38e9881b732fe6b663dee86e6976726fdcd0"
Jul 15 17:09:08.478719 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:09:08.478512    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv_odh-ai-gateway-infra(3d642a7a-f5b5-4359-849c-a839bf052438)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" podUID="3d642a7a-f5b5-4359-849c-a839bf052438"
Jul 15 17:09:08.580066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:08.580027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:20.018809 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:20.018754    2575 scope.go:117] "RemoveContainer" containerID="24868954df03fff16dbc92538ece38e9881b732fe6b663dee86e6976726fdcd0"
Jul 15 17:09:20.535043 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:20.535010    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" event={"ID":"3d642a7a-f5b5-4359-849c-a839bf052438","Type":"ContainerStarted","Data":"b93fe7045d926d3189a1fa6ae978c52316878fd448bf63e58b88637b1d7d4df2"}
Jul 15 17:09:20.551083 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:20.551028    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" podStartSLOduration=16.551012151 podStartE2EDuration="16.551012151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:09:20.550554296 +0000 UTC m=+1747.120429591" watchObservedRunningTime="2026-07-15 17:09:20.551012151 +0000 UTC m=+1747.120887491"
Jul 15 17:09:21.541308 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:21.541274    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d642a7a-f5b5-4359-849c-a839bf052438" containerID="b93fe7045d926d3189a1fa6ae978c52316878fd448bf63e58b88637b1d7d4df2" exitCode=0
Jul 15 17:09:21.541739 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:21.541344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" event={"ID":"3d642a7a-f5b5-4359-849c-a839bf052438","Type":"ContainerDied","Data":"b93fe7045d926d3189a1fa6ae978c52316878fd448bf63e58b88637b1d7d4df2"}
Jul 15 17:09:21.541739 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:21.541420    2575 scope.go:117] "RemoveContainer" containerID="24868954df03fff16dbc92538ece38e9881b732fe6b663dee86e6976726fdcd0"
Jul 15 17:09:21.562519 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:21.562489    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"]
Jul 15 17:09:22.681608 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:22.681581    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:22.768641 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:22.768602    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d642a7a-f5b5-4359-849c-a839bf052438-maas-api-service-ca\") pod \"3d642a7a-f5b5-4359-849c-a839bf052438\" (UID: \"3d642a7a-f5b5-4359-849c-a839bf052438\") "
Jul 15 17:09:22.769056 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:22.769033    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d642a7a-f5b5-4359-849c-a839bf052438-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d642a7a-f5b5-4359-849c-a839bf052438" (UID: "3d642a7a-f5b5-4359-849c-a839bf052438"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:09:22.870113 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:22.870072    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d642a7a-f5b5-4359-849c-a839bf052438-maas-api-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:09:23.558160 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:23.558129    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"
Jul 15 17:09:23.558160 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:23.558146    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv" event={"ID":"3d642a7a-f5b5-4359-849c-a839bf052438","Type":"ContainerDied","Data":"67031991a57bb59ee1a498c689f0164d9066d9f2de8ae83a5269c229c5193b07"}
Jul 15 17:09:23.558405 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:23.558201    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67031991a57bb59ee1a498c689f0164d9066d9f2de8ae83a5269c229c5193b07"
Jul 15 17:09:23.586077 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:23.586040    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"]
Jul 15 17:09:23.589932 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:23.589907    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-bq7qv"]
Jul 15 17:09:24.029596 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:24.029553    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" path="/var/lib/kubelet/pods/3d642a7a-f5b5-4359-849c-a839bf052438/volumes"
Jul 15 17:09:54.186973 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.186936    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:54.835692 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.835651    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"]
Jul 15 17:09:54.836108 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836088    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.836199 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836111    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.836199 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836156    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.836199 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836166    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.836353 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836250    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.836353 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836262    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.836353 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.836273    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:09:54.839292 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.839268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:54.842244 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.842216    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\""
Jul 15 17:09:54.846483 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.846456    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"]
Jul 15 17:09:54.967082 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:54.967038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b45259-c4f1-483f-976e-6ebd54ba160b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff\" (UID: \"69b45259-c4f1-483f-976e-6ebd54ba160b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:55.068185 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.068146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b45259-c4f1-483f-976e-6ebd54ba160b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff\" (UID: \"69b45259-c4f1-483f-976e-6ebd54ba160b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:55.068779 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.068756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b45259-c4f1-483f-976e-6ebd54ba160b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff\" (UID: \"69b45259-c4f1-483f-976e-6ebd54ba160b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:55.151504 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.151393    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:55.284405 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.284380    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"]
Jul 15 17:09:55.286280 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:09:55.286240    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b45259_c4f1_483f_976e_6ebd54ba160b.slice/crio-c43374f7c52cf18cc6485bf1aa9a61d48571b4bf50022f9c65e0956f6bf4ab1f WatchSource:0}: Error finding container c43374f7c52cf18cc6485bf1aa9a61d48571b4bf50022f9c65e0956f6bf4ab1f: Status 404 returned error can't find the container with id c43374f7c52cf18cc6485bf1aa9a61d48571b4bf50022f9c65e0956f6bf4ab1f
Jul 15 17:09:55.370013 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.369975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:09:55.705096 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.704982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff" event={"ID":"69b45259-c4f1-483f-976e-6ebd54ba160b","Type":"ContainerStarted","Data":"7bae5702d7c75daa4ec07eced6afacda23441b40a364bf69957167c028277756"}
Jul 15 17:09:55.705096 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.705068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff" event={"ID":"69b45259-c4f1-483f-976e-6ebd54ba160b","Type":"ContainerStarted","Data":"c43374f7c52cf18cc6485bf1aa9a61d48571b4bf50022f9c65e0956f6bf4ab1f"}
Jul 15 17:09:55.721535 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:55.721471    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff" podStartSLOduration=1.72145565 podStartE2EDuration="1.72145565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:09:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:09:55.719884704 +0000 UTC m=+1782.289760002" watchObservedRunningTime="2026-07-15 17:09:55.72145565 +0000 UTC m=+1782.291330946"
Jul 15 17:09:56.711544 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:56.711502    2575 generic.go:356] "Generic (PLEG): container finished" podID="69b45259-c4f1-483f-976e-6ebd54ba160b" containerID="7bae5702d7c75daa4ec07eced6afacda23441b40a364bf69957167c028277756" exitCode=0
Jul 15 17:09:56.711977 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:56.711588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff" event={"ID":"69b45259-c4f1-483f-976e-6ebd54ba160b","Type":"ContainerDied","Data":"7bae5702d7c75daa4ec07eced6afacda23441b40a364bf69957167c028277756"}
Jul 15 17:09:57.850346 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:57.850317    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:57.896646 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:57.896606    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b45259-c4f1-483f-976e-6ebd54ba160b-maas-api-service-ca\") pod \"69b45259-c4f1-483f-976e-6ebd54ba160b\" (UID: \"69b45259-c4f1-483f-976e-6ebd54ba160b\") "
Jul 15 17:09:57.897002 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:57.896978    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69b45259-c4f1-483f-976e-6ebd54ba160b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69b45259-c4f1-483f-976e-6ebd54ba160b" (UID: "69b45259-c4f1-483f-976e-6ebd54ba160b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:09:57.997904 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:57.997781    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b45259-c4f1-483f-976e-6ebd54ba160b-maas-api-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:09:58.721942 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:58.721914    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff"
Jul 15 17:09:58.722135 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:58.721949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff" event={"ID":"69b45259-c4f1-483f-976e-6ebd54ba160b","Type":"ContainerDied","Data":"c43374f7c52cf18cc6485bf1aa9a61d48571b4bf50022f9c65e0956f6bf4ab1f"}
Jul 15 17:09:58.722135 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:09:58.721996    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c43374f7c52cf18cc6485bf1aa9a61d48571b4bf50022f9c65e0956f6bf4ab1f"
Jul 15 17:10:04.930948 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:04.930908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:05.043628 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:05.043572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:05.381377 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:05.381327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:08.575005 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:08.574963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:11.043329 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:11.043293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:11.143419 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:11.143378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:11.269458 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:11.269429    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:12.455518 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.455483    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"]
Jul 15 17:10:12.456032 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.455933    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b45259-c4f1-483f-976e-6ebd54ba160b" containerName="revoke-keys"
Jul 15 17:10:12.456032 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.455947    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b45259-c4f1-483f-976e-6ebd54ba160b" containerName="revoke-keys"
Jul 15 17:10:12.456032 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.455969    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:10:12.456032 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.455975    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d642a7a-f5b5-4359-849c-a839bf052438" containerName="revoke-keys"
Jul 15 17:10:12.456032 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.456035    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b45259-c4f1-483f-976e-6ebd54ba160b" containerName="revoke-keys"
Jul 15 17:10:12.459077 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.459053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.462305 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.462280    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3e01659b-serving-cert\""
Jul 15 17:10:12.462435 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.462331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:10:12.470202 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.470169    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"]
Jul 15 17:10:12.638106 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.638062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c0962d-4403-42ca-8375-7fd0e5a21cc8-openshift-service-ca\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.638293 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.638112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mmsn\" (UniqueName: \"kubernetes.io/projected/75c0962d-4403-42ca-8375-7fd0e5a21cc8-kube-api-access-9mmsn\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.638293 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.638235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c0962d-4403-42ca-8375-7fd0e5a21cc8-maas-api-tls\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.739624 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.739532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c0962d-4403-42ca-8375-7fd0e5a21cc8-maas-api-tls\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.739624 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.739599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c0962d-4403-42ca-8375-7fd0e5a21cc8-openshift-service-ca\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.739866 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.739754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mmsn\" (UniqueName: \"kubernetes.io/projected/75c0962d-4403-42ca-8375-7fd0e5a21cc8-kube-api-access-9mmsn\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.740273 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.740250    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c0962d-4403-42ca-8375-7fd0e5a21cc8-openshift-service-ca\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.742077 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.742051    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c0962d-4403-42ca-8375-7fd0e5a21cc8-maas-api-tls\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.749081 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.749056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mmsn\" (UniqueName: \"kubernetes.io/projected/75c0962d-4403-42ca-8375-7fd0e5a21cc8-kube-api-access-9mmsn\") pod \"maas-api-e2e-ait-3e01659b-798fcb577c-86752\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.771980 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.771939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:12.909207 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:12.909181    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"]
Jul 15 17:10:12.911391 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:10:12.911363    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c0962d_4403_42ca_8375_7fd0e5a21cc8.slice/crio-3328bbf2dba6a6ca584683ad141990ca9099b205a3a1a8ea33f2671028135ca4 WatchSource:0}: Error finding container 3328bbf2dba6a6ca584683ad141990ca9099b205a3a1a8ea33f2671028135ca4: Status 404 returned error can't find the container with id 3328bbf2dba6a6ca584683ad141990ca9099b205a3a1a8ea33f2671028135ca4
Jul 15 17:10:13.238092 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:13.238031    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:13.404639 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:13.404570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:13.791396 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:13.791357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752" event={"ID":"75c0962d-4403-42ca-8375-7fd0e5a21cc8","Type":"ContainerStarted","Data":"3328bbf2dba6a6ca584683ad141990ca9099b205a3a1a8ea33f2671028135ca4"}
Jul 15 17:10:13.996701 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:13.996667    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:10:14.006628 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:14.006596    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:10:14.991877 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:14.991819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:10:15.801718 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:15.801681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752" event={"ID":"75c0962d-4403-42ca-8375-7fd0e5a21cc8","Type":"ContainerStarted","Data":"744a45b145322ae5ccbdea0e295f1aac1250215d3f606b7e8ef4842b79b729a3"}
Jul 15 17:10:15.801939 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:15.801812    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:10:15.821329 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:15.821271    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752" podStartSLOduration=1.5435824930000002 podStartE2EDuration="3.821253588s" totalImagesPullingTime="2.277671095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:10:15.818921692 +0000 UTC m=+1802.388796988" watchObservedRunningTime="2026-07-15 17:10:15.821253588 +0000 UTC m=+1802.391128897"
Jul 15 17:10:21.812137 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:10:21.812050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:11:17.947521 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:17.947487    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"]
Jul 15 17:11:17.948080 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:17.947752    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752" podUID="75c0962d-4403-42ca-8375-7fd0e5a21cc8" containerName="maas-api" containerID="cri-o://744a45b145322ae5ccbdea0e295f1aac1250215d3f606b7e8ef4842b79b729a3" gracePeriod=30
Jul 15 17:11:17.967155 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:17.967125    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:18.105228 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.105186    2575 generic.go:356] "Generic (PLEG): container finished" podID="75c0962d-4403-42ca-8375-7fd0e5a21cc8" containerID="744a45b145322ae5ccbdea0e295f1aac1250215d3f606b7e8ef4842b79b729a3" exitCode=0
Jul 15 17:11:18.105411 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.105256    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752" event={"ID":"75c0962d-4403-42ca-8375-7fd0e5a21cc8","Type":"ContainerDied","Data":"744a45b145322ae5ccbdea0e295f1aac1250215d3f606b7e8ef4842b79b729a3"}
Jul 15 17:11:18.199700 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.199626    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:11:18.256978 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.256941    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c0962d-4403-42ca-8375-7fd0e5a21cc8-maas-api-tls\") pod \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") "
Jul 15 17:11:18.257156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.257034    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c0962d-4403-42ca-8375-7fd0e5a21cc8-openshift-service-ca\") pod \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") "
Jul 15 17:11:18.257156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.257077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mmsn\" (UniqueName: \"kubernetes.io/projected/75c0962d-4403-42ca-8375-7fd0e5a21cc8-kube-api-access-9mmsn\") pod \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\" (UID: \"75c0962d-4403-42ca-8375-7fd0e5a21cc8\") "
Jul 15 17:11:18.257470 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.257438    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75c0962d-4403-42ca-8375-7fd0e5a21cc8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75c0962d-4403-42ca-8375-7fd0e5a21cc8" (UID: "75c0962d-4403-42ca-8375-7fd0e5a21cc8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:11:18.259234 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.259209    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c0962d-4403-42ca-8375-7fd0e5a21cc8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75c0962d-4403-42ca-8375-7fd0e5a21cc8" (UID: "75c0962d-4403-42ca-8375-7fd0e5a21cc8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:11:18.259328 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.259298    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c0962d-4403-42ca-8375-7fd0e5a21cc8-kube-api-access-9mmsn" (OuterVolumeSpecName: "kube-api-access-9mmsn") pod "75c0962d-4403-42ca-8375-7fd0e5a21cc8" (UID: "75c0962d-4403-42ca-8375-7fd0e5a21cc8"). InnerVolumeSpecName "kube-api-access-9mmsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:11:18.358360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.358320    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75c0962d-4403-42ca-8375-7fd0e5a21cc8-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:11:18.358360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.358355    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75c0962d-4403-42ca-8375-7fd0e5a21cc8-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:11:18.358360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:18.358365    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mmsn\" (UniqueName: \"kubernetes.io/projected/75c0962d-4403-42ca-8375-7fd0e5a21cc8-kube-api-access-9mmsn\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:11:19.111782 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:19.111747    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"
Jul 15 17:11:19.112280 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:19.111781    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752" event={"ID":"75c0962d-4403-42ca-8375-7fd0e5a21cc8","Type":"ContainerDied","Data":"3328bbf2dba6a6ca584683ad141990ca9099b205a3a1a8ea33f2671028135ca4"}
Jul 15 17:11:19.112280 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:19.111876    2575 scope.go:117] "RemoveContainer" containerID="744a45b145322ae5ccbdea0e295f1aac1250215d3f606b7e8ef4842b79b729a3"
Jul 15 17:11:19.134926 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:19.134894    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"]
Jul 15 17:11:19.139199 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:19.139172    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3e01659b-798fcb577c-86752"]
Jul 15 17:11:20.024247 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:20.024214    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c0962d-4403-42ca-8375-7fd0e5a21cc8" path="/var/lib/kubelet/pods/75c0962d-4403-42ca-8375-7fd0e5a21cc8/volumes"
Jul 15 17:11:22.638965 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:22.638931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:28.417491 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:28.417453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:28.570382 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:28.570347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:33.766068 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:33.766025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:33.999900 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:33.999865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:35.107748 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.107718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:35.208551 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.208478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:35.275279 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.275234    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"]
Jul 15 17:11:35.275755 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.275732    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c0962d-4403-42ca-8375-7fd0e5a21cc8" containerName="maas-api"
Jul 15 17:11:35.275755 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.275756    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c0962d-4403-42ca-8375-7fd0e5a21cc8" containerName="maas-api"
Jul 15 17:11:35.275945 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.275853    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c0962d-4403-42ca-8375-7fd0e5a21cc8" containerName="maas-api"
Jul 15 17:11:35.280425 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.280400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.283059 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.283032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0be65efc-serving-cert\""
Jul 15 17:11:35.283165 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.283063    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:11:35.288617 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.288590    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"]
Jul 15 17:11:35.307173 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.307141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:35.317634 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.317606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c5f9d9d-77e4-4609-9814-164ef2b27afc-maas-api-tls\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.317779 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.317651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5f9d9d-77e4-4609-9814-164ef2b27afc-openshift-service-ca\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.317779 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.317760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8hg\" (UniqueName: \"kubernetes.io/projected/3c5f9d9d-77e4-4609-9814-164ef2b27afc-kube-api-access-bz8hg\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.373183 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.373096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:35.418281 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.418245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c5f9d9d-77e4-4609-9814-164ef2b27afc-maas-api-tls\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.418469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.418306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5f9d9d-77e4-4609-9814-164ef2b27afc-openshift-service-ca\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.418469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.418371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8hg\" (UniqueName: \"kubernetes.io/projected/3c5f9d9d-77e4-4609-9814-164ef2b27afc-kube-api-access-bz8hg\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.419125 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.419098    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5f9d9d-77e4-4609-9814-164ef2b27afc-openshift-service-ca\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.421463 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.421425    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c5f9d9d-77e4-4609-9814-164ef2b27afc-maas-api-tls\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.430758 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.430722    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8hg\" (UniqueName: \"kubernetes.io/projected/3c5f9d9d-77e4-4609-9814-164ef2b27afc-kube-api-access-bz8hg\") pod \"maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.592394 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.592344    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:35.730981 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.730957    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"]
Jul 15 17:11:35.733612 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:11:35.733583    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5f9d9d_77e4_4609_9814_164ef2b27afc.slice/crio-910c2e669aaf94feb1ea865eb3810db87f6a243415f7682ae1a9ffeb397c09b8 WatchSource:0}: Error finding container 910c2e669aaf94feb1ea865eb3810db87f6a243415f7682ae1a9ffeb397c09b8: Status 404 returned error can't find the container with id 910c2e669aaf94feb1ea865eb3810db87f6a243415f7682ae1a9ffeb397c09b8
Jul 15 17:11:35.845293 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.845255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:35.950458 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:35.950366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:36.194345 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:36.194309    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv" event={"ID":"3c5f9d9d-77e4-4609-9814-164ef2b27afc","Type":"ContainerStarted","Data":"910c2e669aaf94feb1ea865eb3810db87f6a243415f7682ae1a9ffeb397c09b8"}
Jul 15 17:11:37.200461 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:37.200424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv" event={"ID":"3c5f9d9d-77e4-4609-9814-164ef2b27afc","Type":"ContainerStarted","Data":"89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a"}
Jul 15 17:11:37.200966 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:37.200512    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:37.218199 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:37.218146    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv" podStartSLOduration=1.739787358 podStartE2EDuration="2.218127637s" totalImagesPullingTime="478.340279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:11:37.216474059 +0000 UTC m=+1883.786349356" watchObservedRunningTime="2026-07-15 17:11:37.218127637 +0000 UTC m=+1883.788003012"
Jul 15 17:11:40.175858 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:40.175820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:40.275910 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:40.275867    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:42.997325 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:42.997285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:43.097876 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:43.097840    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:43.211927 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:43.211896    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:11:43.954622 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:43.954593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:56.695033 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:56.694991    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:11:56.795320 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:11:56.795283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:39.987128 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:39.987091    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"]
Jul 15 17:12:39.989449 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:39.987416    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv" podUID="3c5f9d9d-77e4-4609-9814-164ef2b27afc" containerName="maas-api" containerID="cri-o://89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a" gracePeriod=30
Jul 15 17:12:40.014347 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.014318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:40.236175 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.236145    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:12:40.299375 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.299278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz8hg\" (UniqueName: \"kubernetes.io/projected/3c5f9d9d-77e4-4609-9814-164ef2b27afc-kube-api-access-bz8hg\") pod \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") "
Jul 15 17:12:40.299540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.299378    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5f9d9d-77e4-4609-9814-164ef2b27afc-openshift-service-ca\") pod \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") "
Jul 15 17:12:40.299540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.299432    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c5f9d9d-77e4-4609-9814-164ef2b27afc-maas-api-tls\") pod \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\" (UID: \"3c5f9d9d-77e4-4609-9814-164ef2b27afc\") "
Jul 15 17:12:40.299839 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.299784    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c5f9d9d-77e4-4609-9814-164ef2b27afc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c5f9d9d-77e4-4609-9814-164ef2b27afc" (UID: "3c5f9d9d-77e4-4609-9814-164ef2b27afc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:12:40.301615 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.301592    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5f9d9d-77e4-4609-9814-164ef2b27afc-kube-api-access-bz8hg" (OuterVolumeSpecName: "kube-api-access-bz8hg") pod "3c5f9d9d-77e4-4609-9814-164ef2b27afc" (UID: "3c5f9d9d-77e4-4609-9814-164ef2b27afc"). InnerVolumeSpecName "kube-api-access-bz8hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:12:40.301690 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.301667    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c5f9d9d-77e4-4609-9814-164ef2b27afc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c5f9d9d-77e4-4609-9814-164ef2b27afc" (UID: "3c5f9d9d-77e4-4609-9814-164ef2b27afc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:12:40.400437 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.400394    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz8hg\" (UniqueName: \"kubernetes.io/projected/3c5f9d9d-77e4-4609-9814-164ef2b27afc-kube-api-access-bz8hg\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:12:40.400437 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.400430    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5f9d9d-77e4-4609-9814-164ef2b27afc-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:12:40.400437 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.400441    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c5f9d9d-77e4-4609-9814-164ef2b27afc-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:12:40.510112 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.510073    2575 generic.go:356] "Generic (PLEG): container finished" podID="3c5f9d9d-77e4-4609-9814-164ef2b27afc" containerID="89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a" exitCode=0
Jul 15 17:12:40.510300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.510118    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"
Jul 15 17:12:40.510300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.510158    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv" event={"ID":"3c5f9d9d-77e4-4609-9814-164ef2b27afc","Type":"ContainerDied","Data":"89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a"}
Jul 15 17:12:40.510300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.510212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv" event={"ID":"3c5f9d9d-77e4-4609-9814-164ef2b27afc","Type":"ContainerDied","Data":"910c2e669aaf94feb1ea865eb3810db87f6a243415f7682ae1a9ffeb397c09b8"}
Jul 15 17:12:40.510300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.510236    2575 scope.go:117] "RemoveContainer" containerID="89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a"
Jul 15 17:12:40.518952 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.518928    2575 scope.go:117] "RemoveContainer" containerID="89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a"
Jul 15 17:12:40.519232 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:12:40.519213    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a\": container with ID starting with 89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a not found: ID does not exist" containerID="89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a"
Jul 15 17:12:40.519282 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.519243    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a"} err="failed to get container status \"89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a\": rpc error: code = NotFound desc = could not find container \"89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a\": container with ID starting with 89ad95d73cc7a6a1bcac3d23d7795c71e408dd6a082a632a91d1b9be9f81df9a not found: ID does not exist"
Jul 15 17:12:40.530571 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.530539    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"]
Jul 15 17:12:40.533415 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:40.533389    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0be65efc-68cb7f9fb9-g8khv"]
Jul 15 17:12:42.023721 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:42.023687    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c5f9d9d-77e4-4609-9814-164ef2b27afc" path="/var/lib/kubelet/pods/3c5f9d9d-77e4-4609-9814-164ef2b27afc/volumes"
Jul 15 17:12:44.684454 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:44.684421    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:50.298633 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:50.298596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:50.398613 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:50.398580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:54.865998 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:54.865962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:55.470301 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:55.470263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:55.567253 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:55.567219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:55.667609 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:55.667575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:12:57.134435 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:12:57.134398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:01.546127 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:01.546085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:03.073269 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:03.073230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:03.174412 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:03.174376    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:03.276587 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:03.276543    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:03.374243 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:03.374159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:03.707540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:03.707448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:29.689160 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:29.689118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:35.370452 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:35.370412    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:35.430836 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:35.430778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:35.524770 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:35.524734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:35.623538 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:35.623442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:51.481924 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:51.481881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:57.249649 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:57.249615    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:57.304194 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:57.304160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:57.393674 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:57.393632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:13:57.494116 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:13:57.494081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:07.985286 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:07.985237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:08.799053 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:08.799017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:14.598918 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:14.598878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:14.656247 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:14.656210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:14.744019 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:14.743980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:14.840929 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:14.840891    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:14.940983 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:14.940896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:15.677147 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:15.677115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:15.780761 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:15.780721    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:16.265707 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:16.265671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:17.562234 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:17.562192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:23.250360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:23.250326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:23.350497 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:23.350465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:24.971344 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:24.971312    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:30.647643 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:30.647601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:30.712036 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:30.712004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:30.884505 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:30.884469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:31.207648 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:31.207603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:31.386975 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:31.386947    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:33.973697 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:33.973664    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:34.059969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.059929    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"]
Jul 15 17:14:34.060382 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.060363    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5f9d9d-77e4-4609-9814-164ef2b27afc" containerName="maas-api"
Jul 15 17:14:34.060474 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.060383    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5f9d9d-77e4-4609-9814-164ef2b27afc" containerName="maas-api"
Jul 15 17:14:34.060474 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.060471    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c5f9d9d-77e4-4609-9814-164ef2b27afc" containerName="maas-api"
Jul 15 17:14:34.063621 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.063596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.066233 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.066212    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-68500967-serving-cert\""
Jul 15 17:14:34.066372 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.066293    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:14:34.069612 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.069582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:34.073420 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.073398    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"]
Jul 15 17:14:34.139170 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.139136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:34.165469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.165426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2babcf6-32a6-421f-bf8b-4e736755f2c0-openshift-service-ca\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.165656 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.165558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.165656 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.165613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlbnr\" (UniqueName: \"kubernetes.io/projected/f2babcf6-32a6-421f-bf8b-4e736755f2c0-kube-api-access-xlbnr\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.266163 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.266062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2babcf6-32a6-421f-bf8b-4e736755f2c0-openshift-service-ca\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.266328 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.266163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.266328 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.266214    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlbnr\" (UniqueName: \"kubernetes.io/projected/f2babcf6-32a6-421f-bf8b-4e736755f2c0-kube-api-access-xlbnr\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.266328 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:14:34.266312    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-68500967-serving-cert: secret "maas-api-e2e-mt-68500967-serving-cert" not found
Jul 15 17:14:34.266483 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:14:34.266394    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls podName:f2babcf6-32a6-421f-bf8b-4e736755f2c0 nodeName:}" failed. No retries permitted until 2026-07-15 17:14:34.76637162 +0000 UTC m=+2061.336246894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls") pod "maas-api-e2e-mt-68500967-986d59576-5vwbk" (UID: "f2babcf6-32a6-421f-bf8b-4e736755f2c0") : secret "maas-api-e2e-mt-68500967-serving-cert" not found
Jul 15 17:14:34.266917 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.266898    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2babcf6-32a6-421f-bf8b-4e736755f2c0-openshift-service-ca\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.278809 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.278765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlbnr\" (UniqueName: \"kubernetes.io/projected/f2babcf6-32a6-421f-bf8b-4e736755f2c0-kube-api-access-xlbnr\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.400483 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.400446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:34.631803 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.631757    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:34.731635 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.731598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:34.769910 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.769875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.772202 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.772181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls\") pod \"maas-api-e2e-mt-68500967-986d59576-5vwbk\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:34.976141 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:34.976045    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:35.117165 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:35.116999    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"]
Jul 15 17:14:35.120280 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:14:35.120253    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2babcf6_32a6_421f_bf8b_4e736755f2c0.slice/crio-2b1b2a5d946a81c6a4591305ad2f04298936e2e8c80c11f86d52dbdc4ac1145a WatchSource:0}: Error finding container 2b1b2a5d946a81c6a4591305ad2f04298936e2e8c80c11f86d52dbdc4ac1145a: Status 404 returned error can't find the container with id 2b1b2a5d946a81c6a4591305ad2f04298936e2e8c80c11f86d52dbdc4ac1145a
Jul 15 17:14:35.121944 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:35.121923    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:14:36.064305 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:36.064199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk" event={"ID":"f2babcf6-32a6-421f-bf8b-4e736755f2c0","Type":"ContainerStarted","Data":"8d027e518ab69c5979fbe5e99ec30af139cac6a79ba90b143e269468066202df"}
Jul 15 17:14:36.064305 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:36.064260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk" event={"ID":"f2babcf6-32a6-421f-bf8b-4e736755f2c0","Type":"ContainerStarted","Data":"2b1b2a5d946a81c6a4591305ad2f04298936e2e8c80c11f86d52dbdc4ac1145a"}
Jul 15 17:14:36.064835 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:36.064325    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:36.084783 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:36.084728    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk" podStartSLOduration=1.620650404 podStartE2EDuration="2.084711378s" totalImagesPullingTime="464.060974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:14:36.082992376 +0000 UTC m=+2062.652867666" watchObservedRunningTime="2026-07-15 17:14:36.084711378 +0000 UTC m=+2062.654586674"
Jul 15 17:14:38.465055 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:38.465014    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:39.125844 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:39.125808    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:39.236413 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:39.236374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:39.649376 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:39.649326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:42.075810 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:42.075760    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:45.214533 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:45.214501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:45.276538 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:45.276495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:55.980986 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:55.980946    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"]
Jul 15 17:14:55.981591 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:55.981211    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk" podUID="f2babcf6-32a6-421f-bf8b-4e736755f2c0" containerName="maas-api" containerID="cri-o://8d027e518ab69c5979fbe5e99ec30af139cac6a79ba90b143e269468066202df" gracePeriod=30
Jul 15 17:14:56.008202 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.008168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:14:56.160023 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.159993    2575 generic.go:356] "Generic (PLEG): container finished" podID="f2babcf6-32a6-421f-bf8b-4e736755f2c0" containerID="8d027e518ab69c5979fbe5e99ec30af139cac6a79ba90b143e269468066202df" exitCode=0
Jul 15 17:14:56.160174 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.160046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk" event={"ID":"f2babcf6-32a6-421f-bf8b-4e736755f2c0","Type":"ContainerDied","Data":"8d027e518ab69c5979fbe5e99ec30af139cac6a79ba90b143e269468066202df"}
Jul 15 17:14:56.234698 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.234619    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:56.384245 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.384195    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2babcf6-32a6-421f-bf8b-4e736755f2c0-openshift-service-ca\") pod \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") "
Jul 15 17:14:56.384245 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.384248    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlbnr\" (UniqueName: \"kubernetes.io/projected/f2babcf6-32a6-421f-bf8b-4e736755f2c0-kube-api-access-xlbnr\") pod \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") "
Jul 15 17:14:56.384468 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.384287    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls\") pod \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\" (UID: \"f2babcf6-32a6-421f-bf8b-4e736755f2c0\") "
Jul 15 17:14:56.384653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.384631    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2babcf6-32a6-421f-bf8b-4e736755f2c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2babcf6-32a6-421f-bf8b-4e736755f2c0" (UID: "f2babcf6-32a6-421f-bf8b-4e736755f2c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:14:56.386491 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.386470    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2babcf6-32a6-421f-bf8b-4e736755f2c0-kube-api-access-xlbnr" (OuterVolumeSpecName: "kube-api-access-xlbnr") pod "f2babcf6-32a6-421f-bf8b-4e736755f2c0" (UID: "f2babcf6-32a6-421f-bf8b-4e736755f2c0"). InnerVolumeSpecName "kube-api-access-xlbnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:14:56.386589 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.386472    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2babcf6-32a6-421f-bf8b-4e736755f2c0" (UID: "f2babcf6-32a6-421f-bf8b-4e736755f2c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:14:56.485252 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.485162    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2babcf6-32a6-421f-bf8b-4e736755f2c0-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:14:56.485252 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.485196    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlbnr\" (UniqueName: \"kubernetes.io/projected/f2babcf6-32a6-421f-bf8b-4e736755f2c0-kube-api-access-xlbnr\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:14:56.485252 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:56.485205    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2babcf6-32a6-421f-bf8b-4e736755f2c0-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:14:57.166475 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:57.166445    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"
Jul 15 17:14:57.166475 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:57.166469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk" event={"ID":"f2babcf6-32a6-421f-bf8b-4e736755f2c0","Type":"ContainerDied","Data":"2b1b2a5d946a81c6a4591305ad2f04298936e2e8c80c11f86d52dbdc4ac1145a"}
Jul 15 17:14:57.167000 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:57.166526    2575 scope.go:117] "RemoveContainer" containerID="8d027e518ab69c5979fbe5e99ec30af139cac6a79ba90b143e269468066202df"
Jul 15 17:14:57.187415 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:57.187383    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"]
Jul 15 17:14:57.190548 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:57.190525    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68500967-986d59576-5vwbk"]
Jul 15 17:14:58.024863 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:14:58.024831    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2babcf6-32a6-421f-bf8b-4e736755f2c0" path="/var/lib/kubelet/pods/f2babcf6-32a6-421f-bf8b-4e736755f2c0/volumes"
Jul 15 17:15:00.134677 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.134638    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"]
Jul 15 17:15:00.135105 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.135003    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2babcf6-32a6-421f-bf8b-4e736755f2c0" containerName="maas-api"
Jul 15 17:15:00.135105 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.135015    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2babcf6-32a6-421f-bf8b-4e736755f2c0" containerName="maas-api"
Jul 15 17:15:00.135105 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.135078    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2babcf6-32a6-421f-bf8b-4e736755f2c0" containerName="maas-api"
Jul 15 17:15:00.139369 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.139347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"
Jul 15 17:15:00.142121 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.142092    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\""
Jul 15 17:15:00.148109 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.148080    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"]
Jul 15 17:15:00.149956 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.149937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"
Jul 15 17:15:00.282035 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.282005    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"]
Jul 15 17:15:00.654757 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:00.654715    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:01.187309 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:01.187269    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r" event={"ID":"fc5c8031-1292-4a05-ac14-6d54e76e7a13","Type":"ContainerStarted","Data":"47b72ec87fcb2b7a3e3706cf2d1149a9dad605f02ce9223a1be69870fb010564"}
Jul 15 17:15:01.187724 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:01.187329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r" event={"ID":"fc5c8031-1292-4a05-ac14-6d54e76e7a13","Type":"ContainerStarted","Data":"79a215215764a8cc7d8998400e2ed7e7b7450a306ab98412a72257585d7b2e3d"}
Jul 15 17:15:01.203459 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:01.203400    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r" podStartSLOduration=1.203380805 podStartE2EDuration="1.203380805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:15:01.202684446 +0000 UTC m=+2087.772559745" watchObservedRunningTime="2026-07-15 17:15:01.203380805 +0000 UTC m=+2087.773256101"
Jul 15 17:15:02.193247 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:02.193216    2575 generic.go:356] "Generic (PLEG): container finished" podID="fc5c8031-1292-4a05-ac14-6d54e76e7a13" containerID="47b72ec87fcb2b7a3e3706cf2d1149a9dad605f02ce9223a1be69870fb010564" exitCode=0
Jul 15 17:15:02.193764 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:02.193298    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r" event={"ID":"fc5c8031-1292-4a05-ac14-6d54e76e7a13","Type":"ContainerDied","Data":"47b72ec87fcb2b7a3e3706cf2d1149a9dad605f02ce9223a1be69870fb010564"}
Jul 15 17:15:03.336201 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:03.336172    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"
Jul 15 17:15:04.204536 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:04.204505    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r"
Jul 15 17:15:04.204724 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:04.204508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735595-l2m5r" event={"ID":"fc5c8031-1292-4a05-ac14-6d54e76e7a13","Type":"ContainerDied","Data":"79a215215764a8cc7d8998400e2ed7e7b7450a306ab98412a72257585d7b2e3d"}
Jul 15 17:15:04.204724 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:04.204632    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79a215215764a8cc7d8998400e2ed7e7b7450a306ab98412a72257585d7b2e3d"
Jul 15 17:15:06.674441 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:06.674404    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:06.774322 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:06.774286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:11.718029 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:11.717993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:11.816913 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:11.816883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:11.915998 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:11.915954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:14.026238 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:14.026208    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:15:14.037497 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:14.037468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:15:17.544398 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:17.544360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:17.746467 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:17.746430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:17.825416 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:17.825388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:17.924880 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:17.924841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:23.488251 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:23.488179    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:23.587566 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:23.587531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:30.268219 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:30.268167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:30.598870 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:30.598833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:30.786505 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:30.786443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:33.249872 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.249831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:33.332477 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.332446    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:33.336232 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.336206    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"]
Jul 15 17:15:33.336680 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.336665    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5c8031-1292-4a05-ac14-6d54e76e7a13" containerName="cleanup"
Jul 15 17:15:33.336751 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.336681    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5c8031-1292-4a05-ac14-6d54e76e7a13" containerName="cleanup"
Jul 15 17:15:33.336829 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.336751    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5c8031-1292-4a05-ac14-6d54e76e7a13" containerName="cleanup"
Jul 15 17:15:33.340317 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.340280    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.342977 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.342950    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1858e64a-serving-cert\""
Jul 15 17:15:33.343157 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.343125    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:15:33.351078 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.351052    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"]
Jul 15 17:15:33.404242 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.404192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:33.422472 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.422428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdzff\" (UniqueName: \"kubernetes.io/projected/215f2320-8c0a-45e9-8085-51e4c679aa44-kube-api-access-bdzff\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.422649 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.422476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.422649 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.422504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/215f2320-8c0a-45e9-8085-51e4c679aa44-openshift-service-ca\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.523306 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.523211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdzff\" (UniqueName: \"kubernetes.io/projected/215f2320-8c0a-45e9-8085-51e4c679aa44-kube-api-access-bdzff\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.523306 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.523258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.523306 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.523282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/215f2320-8c0a-45e9-8085-51e4c679aa44-openshift-service-ca\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.523560 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:15:33.523428    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-serving-cert: secret "maas-api-e2e-mt-1858e64a-serving-cert" not found
Jul 15 17:15:33.523560 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:15:33.523511    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls podName:215f2320-8c0a-45e9-8085-51e4c679aa44 nodeName:}" failed. No retries permitted until 2026-07-15 17:15:34.023488668 +0000 UTC m=+2120.593363955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls") pod "maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" (UID: "215f2320-8c0a-45e9-8085-51e4c679aa44") : secret "maas-api-e2e-mt-1858e64a-serving-cert" not found
Jul 15 17:15:33.524088 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.524070    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/215f2320-8c0a-45e9-8085-51e4c679aa44-openshift-service-ca\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.532110 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.532082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdzff\" (UniqueName: \"kubernetes.io/projected/215f2320-8c0a-45e9-8085-51e4c679aa44-kube-api-access-bdzff\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:33.842298 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.842264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:33.943118 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:33.943087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:34.028602 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:34.028568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:34.031185 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:34.031159    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls\") pod \"maas-api-e2e-mt-1858e64a-8ff5b846c-twptb\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:34.048614 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:34.048579    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:34.253503 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:34.253407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:34.392264 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:34.392238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"]
Jul 15 17:15:34.394412 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:15:34.394381    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215f2320_8c0a_45e9_8085_51e4c679aa44.slice/crio-f108a81953e3a01e376fc9617ba5ea374a2bbb757d85b9a1fe975deefc1b6978 WatchSource:0}: Error finding container f108a81953e3a01e376fc9617ba5ea374a2bbb757d85b9a1fe975deefc1b6978: Status 404 returned error can't find the container with id f108a81953e3a01e376fc9617ba5ea374a2bbb757d85b9a1fe975deefc1b6978
Jul 15 17:15:35.361019 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:35.360968    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" event={"ID":"215f2320-8c0a-45e9-8085-51e4c679aa44","Type":"ContainerStarted","Data":"724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e"}
Jul 15 17:15:35.361447 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:35.361077    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:35.361447 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:35.361103    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" event={"ID":"215f2320-8c0a-45e9-8085-51e4c679aa44","Type":"ContainerStarted","Data":"f108a81953e3a01e376fc9617ba5ea374a2bbb757d85b9a1fe975deefc1b6978"}
Jul 15 17:15:35.377625 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:35.377575    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" podStartSLOduration=2.080301511 podStartE2EDuration="2.377558014s" totalImagesPullingTime="297.256503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:15:35.377363297 +0000 UTC m=+2121.947238594" watchObservedRunningTime="2026-07-15 17:15:35.377558014 +0000 UTC m=+2121.947433310"
Jul 15 17:15:37.736225 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:37.736189    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:15:41.372305 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:41.372274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:15:44.137860 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:15:44.137822    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:16:14.118109 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:14.118032    2575 scope.go:117] "RemoveContainer" containerID="b93fe7045d926d3189a1fa6ae978c52316878fd448bf63e58b88637b1d7d4df2"
Jul 15 17:16:41.786945 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:41.786895    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"]
Jul 15 17:16:41.787426 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:41.787159    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" podUID="215f2320-8c0a-45e9-8085-51e4c679aa44" containerName="maas-api" containerID="cri-o://724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e" gracePeriod=30
Jul 15 17:16:41.817697 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:41.817642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:16:42.044521 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.044448    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:16:42.157502 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.157461    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls\") pod \"215f2320-8c0a-45e9-8085-51e4c679aa44\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") "
Jul 15 17:16:42.157502 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.157505    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdzff\" (UniqueName: \"kubernetes.io/projected/215f2320-8c0a-45e9-8085-51e4c679aa44-kube-api-access-bdzff\") pod \"215f2320-8c0a-45e9-8085-51e4c679aa44\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") "
Jul 15 17:16:42.157721 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.157584    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/215f2320-8c0a-45e9-8085-51e4c679aa44-openshift-service-ca\") pod \"215f2320-8c0a-45e9-8085-51e4c679aa44\" (UID: \"215f2320-8c0a-45e9-8085-51e4c679aa44\") "
Jul 15 17:16:42.158016 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.157985    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/215f2320-8c0a-45e9-8085-51e4c679aa44-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "215f2320-8c0a-45e9-8085-51e4c679aa44" (UID: "215f2320-8c0a-45e9-8085-51e4c679aa44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:16:42.159717 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.159695    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "215f2320-8c0a-45e9-8085-51e4c679aa44" (UID: "215f2320-8c0a-45e9-8085-51e4c679aa44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:16:42.159842 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.159819    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/215f2320-8c0a-45e9-8085-51e4c679aa44-kube-api-access-bdzff" (OuterVolumeSpecName: "kube-api-access-bdzff") pod "215f2320-8c0a-45e9-8085-51e4c679aa44" (UID: "215f2320-8c0a-45e9-8085-51e4c679aa44"). InnerVolumeSpecName "kube-api-access-bdzff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:16:42.259179 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.259134    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/215f2320-8c0a-45e9-8085-51e4c679aa44-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:16:42.259179 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.259169    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdzff\" (UniqueName: \"kubernetes.io/projected/215f2320-8c0a-45e9-8085-51e4c679aa44-kube-api-access-bdzff\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:16:42.259179 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.259179    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/215f2320-8c0a-45e9-8085-51e4c679aa44-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:16:42.675090 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.675053    2575 generic.go:356] "Generic (PLEG): container finished" podID="215f2320-8c0a-45e9-8085-51e4c679aa44" containerID="724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e" exitCode=0
Jul 15 17:16:42.675090 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.675097    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"
Jul 15 17:16:42.675341 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.675115    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" event={"ID":"215f2320-8c0a-45e9-8085-51e4c679aa44","Type":"ContainerDied","Data":"724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e"}
Jul 15 17:16:42.675341 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.675168    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb" event={"ID":"215f2320-8c0a-45e9-8085-51e4c679aa44","Type":"ContainerDied","Data":"f108a81953e3a01e376fc9617ba5ea374a2bbb757d85b9a1fe975deefc1b6978"}
Jul 15 17:16:42.675341 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.675190    2575 scope.go:117] "RemoveContainer" containerID="724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e"
Jul 15 17:16:42.684774 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.684748    2575 scope.go:117] "RemoveContainer" containerID="724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e"
Jul 15 17:16:42.685113 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:16:42.685088    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e\": container with ID starting with 724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e not found: ID does not exist" containerID="724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e"
Jul 15 17:16:42.685190 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.685123    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e"} err="failed to get container status \"724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e\": rpc error: code = NotFound desc = could not find container \"724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e\": container with ID starting with 724129957c77cf2a887220b058d0039808c6d5f634f115a3f17ab414c312c85e not found: ID does not exist"
Jul 15 17:16:42.697192 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.697158    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"]
Jul 15 17:16:42.700704 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:42.700665    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1858e64a-8ff5b846c-twptb"]
Jul 15 17:16:43.780978 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:43.780939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:16:43.882397 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:43.882364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:16:44.023421 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:44.023382    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="215f2320-8c0a-45e9-8085-51e4c679aa44" path="/var/lib/kubelet/pods/215f2320-8c0a-45e9-8085-51e4c679aa44/volumes"
Jul 15 17:16:46.585272 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:46.585234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:16:51.480536 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:16:51.480495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:27.908832 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:27.908776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:28.849462 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:28.849427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:34.421969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:34.421933    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:39.874992 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:39.874950    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:39.975207 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:39.975171    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:48.704513 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:48.704471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:48.935555 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:48.935525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:49.962047 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:49.962005    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:50.064672 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:50.064631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:50.163996 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:50.163966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:50.851241 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:50.851201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:50.954242 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:50.954201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:51.050564 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:51.050528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:52.544743 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:52.544705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:58.199442 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:58.199402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:58.271550 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:58.271516    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:17:58.869194 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:17:58.869150    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:04.673970 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:04.673930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:04.770154 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:04.770118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:07.122101 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:07.122065    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:07.177277 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:07.177242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:15.316666 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:15.316630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:15.639261 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:15.639225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:36.600402 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:36.600361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:42.334312 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:42.334275    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:42.404100 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:42.404054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:42.692667 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:42.692574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:42.989645 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:42.989563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:43.134586 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:43.134551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:46.207555 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.207521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:46.289659 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.289619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:46.289985 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.289964    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"]
Jul 15 17:18:46.290329 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.290315    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="215f2320-8c0a-45e9-8085-51e4c679aa44" containerName="maas-api"
Jul 15 17:18:46.290371 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.290329    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="215f2320-8c0a-45e9-8085-51e4c679aa44" containerName="maas-api"
Jul 15 17:18:46.290426 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.290391    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="215f2320-8c0a-45e9-8085-51e4c679aa44" containerName="maas-api"
Jul 15 17:18:46.293534 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.293516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.295978 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.295955    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-53dfff-serving-cert\""
Jul 15 17:18:46.296137 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.296044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:18:46.304659 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.304631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"]
Jul 15 17:18:46.350688 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.350651    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:46.426390 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.426350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.426390 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.426389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgnpb\" (UniqueName: \"kubernetes.io/projected/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-kube-api-access-zgnpb\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.426614 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.426493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.527740 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.527643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.527740 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.527721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.527740 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.527741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgnpb\" (UniqueName: \"kubernetes.io/projected/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-kube-api-access-zgnpb\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.527994 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:18:46.527888    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-serving-cert: secret "maas-api-e2e-inf-a-53dfff-serving-cert" not found
Jul 15 17:18:46.527994 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:18:46.527965    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls podName:edd01cb5-beb3-47dd-be2d-5ec87ee1e363 nodeName:}" failed. No retries permitted until 2026-07-15 17:18:47.027948157 +0000 UTC m=+2313.597823430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls") pod "maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" (UID: "edd01cb5-beb3-47dd-be2d-5ec87ee1e363") : secret "maas-api-e2e-inf-a-53dfff-serving-cert" not found
Jul 15 17:18:46.528343 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.528322    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-openshift-service-ca\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.536817 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.536765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgnpb\" (UniqueName: \"kubernetes.io/projected/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-kube-api-access-zgnpb\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:46.759064 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.759025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:46.857890 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.857857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:46.958274 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:46.958236    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:47.032872 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:47.032837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:47.035315 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:47.035297    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls\") pod \"maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:47.205501 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:47.205405    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:47.346051 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:47.346020    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"]
Jul 15 17:18:47.348145 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:18:47.348115    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd01cb5_beb3_47dd_be2d_5ec87ee1e363.slice/crio-339a9e0b602cd10e964f47c81cd928ffabef4b058f99876ac4a25ae0c503adfd WatchSource:0}: Error finding container 339a9e0b602cd10e964f47c81cd928ffabef4b058f99876ac4a25ae0c503adfd: Status 404 returned error can't find the container with id 339a9e0b602cd10e964f47c81cd928ffabef4b058f99876ac4a25ae0c503adfd
Jul 15 17:18:48.268310 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:48.268215    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" event={"ID":"edd01cb5-beb3-47dd-be2d-5ec87ee1e363","Type":"ContainerStarted","Data":"a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1"}
Jul 15 17:18:48.268310 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:48.268274    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" event={"ID":"edd01cb5-beb3-47dd-be2d-5ec87ee1e363","Type":"ContainerStarted","Data":"339a9e0b602cd10e964f47c81cd928ffabef4b058f99876ac4a25ae0c503adfd"}
Jul 15 17:18:48.268310 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:48.268301    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:48.285956 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:48.285895    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" podStartSLOduration=1.809306954 podStartE2EDuration="2.285875857s" totalImagesPullingTime="476.568903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:18:48.285363886 +0000 UTC m=+2314.855239173" watchObservedRunningTime="2026-07-15 17:18:48.285875857 +0000 UTC m=+2314.855751219"
Jul 15 17:18:48.755544 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:48.755499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:50.715567 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:50.715532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:51.039107 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:51.039007    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:51.356317 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:51.356278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:51.559669 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:51.559630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:54.252735 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.252694    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:54.279775 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.279741    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:18:54.353014 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.352976    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:54.359522 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.359495    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"]
Jul 15 17:18:54.363088 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.363058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.365849 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.365830    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c6b351-serving-cert\""
Jul 15 17:18:54.379691 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.379653    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"]
Jul 15 17:18:54.402082 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.402052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlpdb\" (UniqueName: \"kubernetes.io/projected/61157d99-fe6b-44cb-a31d-6286ecd31dc2-kube-api-access-vlpdb\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.402263 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.402097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61157d99-fe6b-44cb-a31d-6286ecd31dc2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.402263 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.402130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.452104 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.452071    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:54.503517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.503428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpdb\" (UniqueName: \"kubernetes.io/projected/61157d99-fe6b-44cb-a31d-6286ecd31dc2-kube-api-access-vlpdb\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.503517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.503481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61157d99-fe6b-44cb-a31d-6286ecd31dc2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.503517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.503513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.503726 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:18:54.503666    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-serving-cert: secret "maas-api-e2e-inf-b-c6b351-serving-cert" not found
Jul 15 17:18:54.503830 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:18:54.503748    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls podName:61157d99-fe6b-44cb-a31d-6286ecd31dc2 nodeName:}" failed. No retries permitted until 2026-07-15 17:18:55.003725969 +0000 UTC m=+2321.573601243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls") pod "maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" (UID: "61157d99-fe6b-44cb-a31d-6286ecd31dc2") : secret "maas-api-e2e-inf-b-c6b351-serving-cert" not found
Jul 15 17:18:54.504275 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.504257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61157d99-fe6b-44cb-a31d-6286ecd31dc2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.512132 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.512111    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlpdb\" (UniqueName: \"kubernetes.io/projected/61157d99-fe6b-44cb-a31d-6286ecd31dc2-kube-api-access-vlpdb\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:54.860782 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:54.860740    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:55.008154 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:55.008104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:55.010614 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:55.010582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls\") pod \"maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:55.021879 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:55.021834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:55.123399 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:55.123308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:18:55.274470 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:55.274429    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:55.428554 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:55.428469    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"]
Jul 15 17:18:55.431971 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:18:55.431940    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61157d99_fe6b_44cb_a31d_6286ecd31dc2.slice/crio-8b1caaa751b15a9099a38e6596949c89b6f638b7822c0b066e16cb15020f2987 WatchSource:0}: Error finding container 8b1caaa751b15a9099a38e6596949c89b6f638b7822c0b066e16cb15020f2987: Status 404 returned error can't find the container with id 8b1caaa751b15a9099a38e6596949c89b6f638b7822c0b066e16cb15020f2987
Jul 15 17:18:56.309283 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:56.309179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" event={"ID":"61157d99-fe6b-44cb-a31d-6286ecd31dc2","Type":"ContainerStarted","Data":"7841beae124756b23a34f41b95a626d4541c6724d1a14d46f349ee0dae47bde8"}
Jul 15 17:18:56.309283 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:56.309234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" event={"ID":"61157d99-fe6b-44cb-a31d-6286ecd31dc2","Type":"ContainerStarted","Data":"8b1caaa751b15a9099a38e6596949c89b6f638b7822c0b066e16cb15020f2987"}
Jul 15 17:18:56.309283 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:56.309254    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:18:56.328892 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:56.328836    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" podStartSLOduration=1.9318220670000001 podStartE2EDuration="2.328819894s" totalImagesPullingTime="396.997827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:18:56.328104829 +0000 UTC m=+2322.897980129" watchObservedRunningTime="2026-07-15 17:18:56.328819894 +0000 UTC m=+2322.898695187"
Jul 15 17:18:58.750447 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:18:58.750403    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:02.319320 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:02.319291    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:19:08.578221 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:08.578136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:08.678961 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:08.678928    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:11.081837 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:11.081797    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:15.756224 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:15.756186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:15.856935 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:15.856900    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:44.921980 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:44.921944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:50.933921 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.933890    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"]
Jul 15 17:19:50.937293 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.937275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:50.940025 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.939995    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c6b351\"/\"openshift-service-ca.crt\""
Jul 15 17:19:50.941159 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.940987    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c6b351\"/\"kube-root-ca.crt\""
Jul 15 17:19:50.941159 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.941017    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c6b351\"/\"default-dockercfg-nn2pr\""
Jul 15 17:19:50.941159 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.941032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c6b351\"/\"test-model-c6b351-kserve-self-signed-certs\""
Jul 15 17:19:50.948781 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.948751    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"]
Jul 15 17:19:50.968118 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:50.968086    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:19:51.034750 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.034707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c5f389d-273b-4e03-9120-2f3cd651b566-tls-certs\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.034953 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.034761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-model-cache\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.034953 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.034822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-tmp-dir\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.034953 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.034871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-home\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.034953 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.034931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-dshm\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.035098 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.034982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2586l\" (UniqueName: \"kubernetes.io/projected/0c5f389d-273b-4e03-9120-2f3cd651b566-kube-api-access-2586l\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136077 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-tmp-dir\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136277 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-home\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136277 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136118    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-dshm\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136277 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2586l\" (UniqueName: \"kubernetes.io/projected/0c5f389d-273b-4e03-9120-2f3cd651b566-kube-api-access-2586l\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136277 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c5f389d-273b-4e03-9120-2f3cd651b566-tls-certs\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136277 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-model-cache\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136552 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136524    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-tmp-dir\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136598 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-home\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.136669 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.136647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-model-cache\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.138477 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.138448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-dshm\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.138848 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.138830    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c5f389d-273b-4e03-9120-2f3cd651b566-tls-certs\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.144741 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.144717    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2586l\" (UniqueName: \"kubernetes.io/projected/0c5f389d-273b-4e03-9120-2f3cd651b566-kube-api-access-2586l\") pod \"test-model-c6b351-kserve-64b9d9bd77-m2f8t\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") " pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.248053 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.247951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:19:51.391300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.391274    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"]
Jul 15 17:19:51.393698 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:19:51.393657    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c5f389d_273b_4e03_9120_2f3cd651b566.slice/crio-ff670624d522fd2b643e7dea92b3ea08dc6b9d284292d7b940d41f2f4f8ba6f6 WatchSource:0}: Error finding container ff670624d522fd2b643e7dea92b3ea08dc6b9d284292d7b940d41f2f4f8ba6f6: Status 404 returned error can't find the container with id ff670624d522fd2b643e7dea92b3ea08dc6b9d284292d7b940d41f2f4f8ba6f6
Jul 15 17:19:51.577619 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.577579    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t" event={"ID":"0c5f389d-273b-4e03-9120-2f3cd651b566","Type":"ContainerStarted","Data":"2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d"}
Jul 15 17:19:51.577859 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.577632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t" event={"ID":"0c5f389d-273b-4e03-9120-2f3cd651b566","Type":"ContainerStarted","Data":"ff670624d522fd2b643e7dea92b3ea08dc6b9d284292d7b940d41f2f4f8ba6f6"}
Jul 15 17:19:51.597229 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:19:51.597175    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t" podStartSLOduration=1.597158779 podStartE2EDuration="1.597158779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:19:51.59550577 +0000 UTC m=+2378.165381066" watchObservedRunningTime="2026-07-15 17:19:51.597158779 +0000 UTC m=+2378.167034075"
Jul 15 17:20:01.248972 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:01.248932    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:20:01.249380 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:01.249026    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:20:01.261733 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:01.261703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:20:01.634244 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:01.634213    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:20:14.055326 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:14.055293    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:20:14.066728 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:14.066702    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:20:28.014683 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:28.014643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:28.909762 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:28.909721    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"]
Jul 15 17:20:29.591533 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:29.591493    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:29.693727 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:29.693673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:29.795361 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:29.795330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:39.590671 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:39.590584    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"]
Jul 15 17:20:39.591160 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:39.590828    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" podUID="edd01cb5-beb3-47dd-be2d-5ec87ee1e363" containerName="maas-api" containerID="cri-o://a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1" gracePeriod=30
Jul 15 17:20:39.619830 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:39.619774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:40.047188 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.047157    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:20:40.211649 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.211544    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-openshift-service-ca\") pod \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") "
Jul 15 17:20:40.211649 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.211611    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls\") pod \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") "
Jul 15 17:20:40.211944 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.211704    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgnpb\" (UniqueName: \"kubernetes.io/projected/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-kube-api-access-zgnpb\") pod \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\" (UID: \"edd01cb5-beb3-47dd-be2d-5ec87ee1e363\") "
Jul 15 17:20:40.212014 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.211966    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edd01cb5-beb3-47dd-be2d-5ec87ee1e363" (UID: "edd01cb5-beb3-47dd-be2d-5ec87ee1e363"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:20:40.213896 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.213864    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edd01cb5-beb3-47dd-be2d-5ec87ee1e363" (UID: "edd01cb5-beb3-47dd-be2d-5ec87ee1e363"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:20:40.214014 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.213902    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-kube-api-access-zgnpb" (OuterVolumeSpecName: "kube-api-access-zgnpb") pod "edd01cb5-beb3-47dd-be2d-5ec87ee1e363" (UID: "edd01cb5-beb3-47dd-be2d-5ec87ee1e363"). InnerVolumeSpecName "kube-api-access-zgnpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:20:40.312556 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.312511    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgnpb\" (UniqueName: \"kubernetes.io/projected/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-kube-api-access-zgnpb\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:40.312556 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.312547    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:40.312556 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.312558    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edd01cb5-beb3-47dd-be2d-5ec87ee1e363-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:40.808261 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.808223    2575 generic.go:356] "Generic (PLEG): container finished" podID="edd01cb5-beb3-47dd-be2d-5ec87ee1e363" containerID="a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1" exitCode=0
Jul 15 17:20:40.808699 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.808277    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"
Jul 15 17:20:40.808699 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.808316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" event={"ID":"edd01cb5-beb3-47dd-be2d-5ec87ee1e363","Type":"ContainerDied","Data":"a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1"}
Jul 15 17:20:40.808699 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.808376    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs" event={"ID":"edd01cb5-beb3-47dd-be2d-5ec87ee1e363","Type":"ContainerDied","Data":"339a9e0b602cd10e964f47c81cd928ffabef4b058f99876ac4a25ae0c503adfd"}
Jul 15 17:20:40.808699 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.808401    2575 scope.go:117] "RemoveContainer" containerID="a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1"
Jul 15 17:20:40.818325 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.818304    2575 scope.go:117] "RemoveContainer" containerID="a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1"
Jul 15 17:20:40.818593 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:20:40.818575    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1\": container with ID starting with a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1 not found: ID does not exist" containerID="a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1"
Jul 15 17:20:40.818643 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.818604    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1"} err="failed to get container status \"a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1\": rpc error: code = NotFound desc = could not find container \"a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1\": container with ID starting with a6c8aaffe69bc8be9be19e963dcb2627b7f3afa8b56df780d37b240adb028be1 not found: ID does not exist"
Jul 15 17:20:40.828668 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.828639    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"]
Jul 15 17:20:40.832189 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:40.832166    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-53dfff-7cc86dd959-2jgvs"]
Jul 15 17:20:42.023525 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:42.023494    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd01cb5-beb3-47dd-be2d-5ec87ee1e363" path="/var/lib/kubelet/pods/edd01cb5-beb3-47dd-be2d-5ec87ee1e363/volumes"
Jul 15 17:20:43.931244 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:43.931181    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t" podUID="0c5f389d-273b-4e03-9120-2f3cd651b566" containerName="main" containerID="cri-o://2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d" gracePeriod=45
Jul 15 17:20:44.177870 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.177845    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:20:44.221403 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.221261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:44.354090 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c5f389d-273b-4e03-9120-2f3cd651b566-tls-certs\") pod \"0c5f389d-273b-4e03-9120-2f3cd651b566\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") "
Jul 15 17:20:44.354304 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354101    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-model-cache\") pod \"0c5f389d-273b-4e03-9120-2f3cd651b566\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") "
Jul 15 17:20:44.354304 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354147    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2586l\" (UniqueName: \"kubernetes.io/projected/0c5f389d-273b-4e03-9120-2f3cd651b566-kube-api-access-2586l\") pod \"0c5f389d-273b-4e03-9120-2f3cd651b566\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") "
Jul 15 17:20:44.354304 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354188    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-home\") pod \"0c5f389d-273b-4e03-9120-2f3cd651b566\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") "
Jul 15 17:20:44.354304 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-dshm\") pod \"0c5f389d-273b-4e03-9120-2f3cd651b566\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") "
Jul 15 17:20:44.354304 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354282    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-tmp-dir\") pod \"0c5f389d-273b-4e03-9120-2f3cd651b566\" (UID: \"0c5f389d-273b-4e03-9120-2f3cd651b566\") "
Jul 15 17:20:44.354663 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354422    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-model-cache" (OuterVolumeSpecName: "model-cache") pod "0c5f389d-273b-4e03-9120-2f3cd651b566" (UID: "0c5f389d-273b-4e03-9120-2f3cd651b566"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:44.354663 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354438    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-home" (OuterVolumeSpecName: "home") pod "0c5f389d-273b-4e03-9120-2f3cd651b566" (UID: "0c5f389d-273b-4e03-9120-2f3cd651b566"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:44.354663 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354648    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0c5f389d-273b-4e03-9120-2f3cd651b566" (UID: "0c5f389d-273b-4e03-9120-2f3cd651b566"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:44.354844 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354667    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-model-cache\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:44.354844 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.354683    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-home\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:44.356596 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.356564    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-dshm" (OuterVolumeSpecName: "dshm") pod "0c5f389d-273b-4e03-9120-2f3cd651b566" (UID: "0c5f389d-273b-4e03-9120-2f3cd651b566"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:20:44.356596 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.356576    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5f389d-273b-4e03-9120-2f3cd651b566-kube-api-access-2586l" (OuterVolumeSpecName: "kube-api-access-2586l") pod "0c5f389d-273b-4e03-9120-2f3cd651b566" (UID: "0c5f389d-273b-4e03-9120-2f3cd651b566"). InnerVolumeSpecName "kube-api-access-2586l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:20:44.356760 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.356650    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c5f389d-273b-4e03-9120-2f3cd651b566-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0c5f389d-273b-4e03-9120-2f3cd651b566" (UID: "0c5f389d-273b-4e03-9120-2f3cd651b566"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:20:44.456075 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.456039    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c5f389d-273b-4e03-9120-2f3cd651b566-tls-certs\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:44.456075 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.456069    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2586l\" (UniqueName: \"kubernetes.io/projected/0c5f389d-273b-4e03-9120-2f3cd651b566-kube-api-access-2586l\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:44.456075 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.456078    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-dshm\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:44.456317 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.456089    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c5f389d-273b-4e03-9120-2f3cd651b566-tmp-dir\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:20:44.830192 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.830151    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c5f389d-273b-4e03-9120-2f3cd651b566" containerID="2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d" exitCode=0
Jul 15 17:20:44.830420 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.830199    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"
Jul 15 17:20:44.830420 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.830240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t" event={"ID":"0c5f389d-273b-4e03-9120-2f3cd651b566","Type":"ContainerDied","Data":"2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d"}
Jul 15 17:20:44.830420 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.830291    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t" event={"ID":"0c5f389d-273b-4e03-9120-2f3cd651b566","Type":"ContainerDied","Data":"ff670624d522fd2b643e7dea92b3ea08dc6b9d284292d7b940d41f2f4f8ba6f6"}
Jul 15 17:20:44.830420 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.830311    2575 scope.go:117] "RemoveContainer" containerID="2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d"
Jul 15 17:20:44.839529 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.839470    2575 scope.go:117] "RemoveContainer" containerID="2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d"
Jul 15 17:20:44.839817 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:20:44.839778    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d\": container with ID starting with 2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d not found: ID does not exist" containerID="2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d"
Jul 15 17:20:44.839925 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.839825    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d"} err="failed to get container status \"2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d\": rpc error: code = NotFound desc = could not find container \"2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d\": container with ID starting with 2645798e252b8943100f5e2689d615a6c673b7b402392f2fb12333042df6013d not found: ID does not exist"
Jul 15 17:20:44.851298 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.851269    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"]
Jul 15 17:20:44.854563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:44.854537    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c6b351/test-model-c6b351-kserve-64b9d9bd77-m2f8t"]
Jul 15 17:20:46.024456 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:46.024413    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5f389d-273b-4e03-9120-2f3cd651b566" path="/var/lib/kubelet/pods/0c5f389d-273b-4e03-9120-2f3cd651b566/volumes"
Jul 15 17:20:49.813369 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:49.813323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:49.909433 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:49.909398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:54.891131 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:54.891099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:55.118622 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:55.118584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:55.773522 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:55.773484    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:20:55.875611 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:20:55.875566    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:05.753485 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:05.753446    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"]
Jul 15 17:21:05.753913 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:05.753768    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" podUID="61157d99-fe6b-44cb-a31d-6286ecd31dc2" containerName="maas-api" containerID="cri-o://7841beae124756b23a34f41b95a626d4541c6724d1a14d46f349ee0dae47bde8" gracePeriod=30
Jul 15 17:21:05.914147 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:05.914115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:06.940715 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:06.940677    2575 generic.go:356] "Generic (PLEG): container finished" podID="61157d99-fe6b-44cb-a31d-6286ecd31dc2" containerID="7841beae124756b23a34f41b95a626d4541c6724d1a14d46f349ee0dae47bde8" exitCode=0
Jul 15 17:21:06.941097 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:06.940746    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" event={"ID":"61157d99-fe6b-44cb-a31d-6286ecd31dc2","Type":"ContainerDied","Data":"7841beae124756b23a34f41b95a626d4541c6724d1a14d46f349ee0dae47bde8"}
Jul 15 17:21:07.004023 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.003998    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:21:07.071701 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.071599    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlpdb\" (UniqueName: \"kubernetes.io/projected/61157d99-fe6b-44cb-a31d-6286ecd31dc2-kube-api-access-vlpdb\") pod \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") "
Jul 15 17:21:07.071701 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.071694    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls\") pod \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") "
Jul 15 17:21:07.072000 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.071774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61157d99-fe6b-44cb-a31d-6286ecd31dc2-openshift-service-ca\") pod \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\" (UID: \"61157d99-fe6b-44cb-a31d-6286ecd31dc2\") "
Jul 15 17:21:07.072138 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.072112    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61157d99-fe6b-44cb-a31d-6286ecd31dc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61157d99-fe6b-44cb-a31d-6286ecd31dc2" (UID: "61157d99-fe6b-44cb-a31d-6286ecd31dc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:21:07.073848 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.073814    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61157d99-fe6b-44cb-a31d-6286ecd31dc2" (UID: "61157d99-fe6b-44cb-a31d-6286ecd31dc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:21:07.073953 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.073863    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61157d99-fe6b-44cb-a31d-6286ecd31dc2-kube-api-access-vlpdb" (OuterVolumeSpecName: "kube-api-access-vlpdb") pod "61157d99-fe6b-44cb-a31d-6286ecd31dc2" (UID: "61157d99-fe6b-44cb-a31d-6286ecd31dc2"). InnerVolumeSpecName "kube-api-access-vlpdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:21:07.173268 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.173228    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61157d99-fe6b-44cb-a31d-6286ecd31dc2-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:21:07.173268 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.173262    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlpdb\" (UniqueName: \"kubernetes.io/projected/61157d99-fe6b-44cb-a31d-6286ecd31dc2-kube-api-access-vlpdb\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:21:07.173268 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.173272    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61157d99-fe6b-44cb-a31d-6286ecd31dc2-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:21:07.946622 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.946584    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd" event={"ID":"61157d99-fe6b-44cb-a31d-6286ecd31dc2","Type":"ContainerDied","Data":"8b1caaa751b15a9099a38e6596949c89b6f638b7822c0b066e16cb15020f2987"}
Jul 15 17:21:07.947084 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.946653    2575 scope.go:117] "RemoveContainer" containerID="7841beae124756b23a34f41b95a626d4541c6724d1a14d46f349ee0dae47bde8"
Jul 15 17:21:07.947084 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.946602    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"
Jul 15 17:21:07.967708 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.967674    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"]
Jul 15 17:21:07.971193 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:07.971161    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c6b351-868f6b8774-pf6dd"]
Jul 15 17:21:08.023500 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:08.023462    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61157d99-fe6b-44cb-a31d-6286ecd31dc2" path="/var/lib/kubelet/pods/61157d99-fe6b-44cb-a31d-6286ecd31dc2/volumes"
Jul 15 17:21:10.319958 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:10.319907    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:16.104751 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:16.104709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:16.205254 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:16.205215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:21.008514 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:21.008456    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:21.230667 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:21.230632    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:21.653398 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:21.653347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:21.907341 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:21.907249    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:22.077838 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:22.077778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:25.085255 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.085218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:25.162469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162435    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"]
Jul 15 17:21:25.162940 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162920    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd01cb5-beb3-47dd-be2d-5ec87ee1e363" containerName="maas-api"
Jul 15 17:21:25.162940 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162941    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd01cb5-beb3-47dd-be2d-5ec87ee1e363" containerName="maas-api"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162950    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61157d99-fe6b-44cb-a31d-6286ecd31dc2" containerName="maas-api"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162955    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="61157d99-fe6b-44cb-a31d-6286ecd31dc2" containerName="maas-api"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162982    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5f389d-273b-4e03-9120-2f3cd651b566" containerName="main"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.162989    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5f389d-273b-4e03-9120-2f3cd651b566" containerName="main"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.163044    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5f389d-273b-4e03-9120-2f3cd651b566" containerName="main"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.163051    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd01cb5-beb3-47dd-be2d-5ec87ee1e363" containerName="maas-api"
Jul 15 17:21:25.163066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.163057    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="61157d99-fe6b-44cb-a31d-6286ecd31dc2" containerName="maas-api"
Jul 15 17:21:25.166114 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.166094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.168923 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.168902    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:21:25.169042 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.168983    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-29071b-serving-cert\""
Jul 15 17:21:25.176955 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.176926    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"]
Jul 15 17:21:25.179067 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.179041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:25.280269 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.280234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:25.339711 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.339610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5b4571-e377-4ef6-b43d-3761547f6b07-maas-api-tls\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.339711 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.339668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsqdq\" (UniqueName: \"kubernetes.io/projected/cb5b4571-e377-4ef6-b43d-3761547f6b07-kube-api-access-hsqdq\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.339711 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.339690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5b4571-e377-4ef6-b43d-3761547f6b07-openshift-service-ca\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.378170 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.378138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:25.440384 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.440345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5b4571-e377-4ef6-b43d-3761547f6b07-openshift-service-ca\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.440585 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.440444    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5b4571-e377-4ef6-b43d-3761547f6b07-maas-api-tls\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.440585 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.440487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsqdq\" (UniqueName: \"kubernetes.io/projected/cb5b4571-e377-4ef6-b43d-3761547f6b07-kube-api-access-hsqdq\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.441054 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.441035    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5b4571-e377-4ef6-b43d-3761547f6b07-openshift-service-ca\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.442991 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.442970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5b4571-e377-4ef6-b43d-3761547f6b07-maas-api-tls\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.448928 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.448904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsqdq\" (UniqueName: \"kubernetes.io/projected/cb5b4571-e377-4ef6-b43d-3761547f6b07-kube-api-access-hsqdq\") pod \"maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.477825 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.477769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:25.620280 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.620249    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"]
Jul 15 17:21:25.622937 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:21:25.622897    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5b4571_e377_4ef6_b43d_3761547f6b07.slice/crio-21ef1000c846a70aa455acaa5bbd072b55742aba0cc8c530f1554ce47a7aea94 WatchSource:0}: Error finding container 21ef1000c846a70aa455acaa5bbd072b55742aba0cc8c530f1554ce47a7aea94: Status 404 returned error can't find the container with id 21ef1000c846a70aa455acaa5bbd072b55742aba0cc8c530f1554ce47a7aea94
Jul 15 17:21:25.624329 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.624308    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:21:25.655110 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.655076    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:25.753819 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:25.753754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:26.034473 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:26.034382    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc" event={"ID":"cb5b4571-e377-4ef6-b43d-3761547f6b07","Type":"ContainerStarted","Data":"21ef1000c846a70aa455acaa5bbd072b55742aba0cc8c530f1554ce47a7aea94"}
Jul 15 17:21:27.040360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:27.040311    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc" event={"ID":"cb5b4571-e377-4ef6-b43d-3761547f6b07","Type":"ContainerStarted","Data":"0d9e016225ef51746c21d725442e795636d5a2c649cf94061363fc175f88349b"}
Jul 15 17:21:27.040781 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:27.040394    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:27.061595 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:27.061538    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc" podStartSLOduration=1.526259226 podStartE2EDuration="2.061521613s" totalImagesPullingTime="535.262387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:21:27.058897572 +0000 UTC m=+2473.628772868" watchObservedRunningTime="2026-07-15 17:21:27.061521613 +0000 UTC m=+2473.631396991"
Jul 15 17:21:29.578235 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:29.578184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:30.035746 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:30.035644    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:30.348713 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:30.348670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:30.828091 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:30.828059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:33.051186 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.051159    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:33.130857 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.130813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:33.199554 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.199519    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"]
Jul 15 17:21:33.203887 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.203857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.206336 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.206308    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-714199-serving-cert\""
Jul 15 17:21:33.214108 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.214079    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"]
Jul 15 17:21:33.217539 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.217515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:33.292845 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.292778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:33.311952 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.311860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dp6l\" (UniqueName: \"kubernetes.io/projected/ede33860-da18-442a-a159-586f58748bae-kube-api-access-4dp6l\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.311952 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.311945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede33860-da18-442a-a159-586f58748bae-openshift-service-ca\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.312165 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.311989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede33860-da18-442a-a159-586f58748bae-maas-api-tls\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.387897 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.387848    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:33.413276 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.413240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede33860-da18-442a-a159-586f58748bae-openshift-service-ca\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.413401 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.413303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede33860-da18-442a-a159-586f58748bae-maas-api-tls\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.413401 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.413328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dp6l\" (UniqueName: \"kubernetes.io/projected/ede33860-da18-442a-a159-586f58748bae-kube-api-access-4dp6l\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.414067 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.414044    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede33860-da18-442a-a159-586f58748bae-openshift-service-ca\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.415888 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.415866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede33860-da18-442a-a159-586f58748bae-maas-api-tls\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.422299 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.422272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dp6l\" (UniqueName: \"kubernetes.io/projected/ede33860-da18-442a-a159-586f58748bae-kube-api-access-4dp6l\") pod \"maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.516487 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.516450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:33.659245 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.659216    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"]
Jul 15 17:21:33.662044 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:21:33.662014    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede33860_da18_442a_a159_586f58748bae.slice/crio-52a722e47ecdf982fd97c958066664179a2ec8007ccd5a3069eb3216c18219e6 WatchSource:0}: Error finding container 52a722e47ecdf982fd97c958066664179a2ec8007ccd5a3069eb3216c18219e6: Status 404 returned error can't find the container with id 52a722e47ecdf982fd97c958066664179a2ec8007ccd5a3069eb3216c18219e6
Jul 15 17:21:33.784969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.784925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:33.885962 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:33.885913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:34.075113 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:34.075061    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl" event={"ID":"ede33860-da18-442a-a159-586f58748bae","Type":"ContainerStarted","Data":"52a722e47ecdf982fd97c958066664179a2ec8007ccd5a3069eb3216c18219e6"}
Jul 15 17:21:35.082273 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:35.082230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl" event={"ID":"ede33860-da18-442a-a159-586f58748bae","Type":"ContainerStarted","Data":"a9da2dcba5b2261951dbb097bc523f88dbb2804f15944daba066c89e5d6e1757"}
Jul 15 17:21:35.082775 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:35.082359    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:35.100267 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:35.100207    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl" podStartSLOduration=1.639746176 podStartE2EDuration="2.100191349s" totalImagesPullingTime="460.445173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:21:35.098570621 +0000 UTC m=+2481.668445917" watchObservedRunningTime="2026-07-15 17:21:35.100191349 +0000 UTC m=+2481.670066719"
Jul 15 17:21:37.609704 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:37.609667    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:41.096229 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:41.096183    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:21:44.618852 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:44.618813    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:44.717666 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:44.717629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:46.222102 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:46.222064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:46.324116 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:46.324080    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:55.374082 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:55.374025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:55.475672 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:55.475640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:55.960459 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:55.960425    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"]
Jul 15 17:21:55.960678 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:55.960645    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc" podUID="cb5b4571-e377-4ef6-b43d-3761547f6b07" containerName="maas-api" containerID="cri-o://0d9e016225ef51746c21d725442e795636d5a2c649cf94061363fc175f88349b" gracePeriod=30
Jul 15 17:21:55.984493 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:55.984462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:21:56.187537 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.187503    2575 generic.go:356] "Generic (PLEG): container finished" podID="cb5b4571-e377-4ef6-b43d-3761547f6b07" containerID="0d9e016225ef51746c21d725442e795636d5a2c649cf94061363fc175f88349b" exitCode=0
Jul 15 17:21:56.187734 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.187581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc" event={"ID":"cb5b4571-e377-4ef6-b43d-3761547f6b07","Type":"ContainerDied","Data":"0d9e016225ef51746c21d725442e795636d5a2c649cf94061363fc175f88349b"}
Jul 15 17:21:56.216042 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.215969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:56.328359 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.328310    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsqdq\" (UniqueName: \"kubernetes.io/projected/cb5b4571-e377-4ef6-b43d-3761547f6b07-kube-api-access-hsqdq\") pod \"cb5b4571-e377-4ef6-b43d-3761547f6b07\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") "
Jul 15 17:21:56.328586 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.328388    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5b4571-e377-4ef6-b43d-3761547f6b07-openshift-service-ca\") pod \"cb5b4571-e377-4ef6-b43d-3761547f6b07\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") "
Jul 15 17:21:56.328586 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.328424    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5b4571-e377-4ef6-b43d-3761547f6b07-maas-api-tls\") pod \"cb5b4571-e377-4ef6-b43d-3761547f6b07\" (UID: \"cb5b4571-e377-4ef6-b43d-3761547f6b07\") "
Jul 15 17:21:56.328773 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.328743    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb5b4571-e377-4ef6-b43d-3761547f6b07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb5b4571-e377-4ef6-b43d-3761547f6b07" (UID: "cb5b4571-e377-4ef6-b43d-3761547f6b07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:21:56.330524 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.330496    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb5b4571-e377-4ef6-b43d-3761547f6b07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb5b4571-e377-4ef6-b43d-3761547f6b07" (UID: "cb5b4571-e377-4ef6-b43d-3761547f6b07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:21:56.330651 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.330560    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb5b4571-e377-4ef6-b43d-3761547f6b07-kube-api-access-hsqdq" (OuterVolumeSpecName: "kube-api-access-hsqdq") pod "cb5b4571-e377-4ef6-b43d-3761547f6b07" (UID: "cb5b4571-e377-4ef6-b43d-3761547f6b07"). InnerVolumeSpecName "kube-api-access-hsqdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:21:56.430119 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.430079    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsqdq\" (UniqueName: \"kubernetes.io/projected/cb5b4571-e377-4ef6-b43d-3761547f6b07-kube-api-access-hsqdq\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:21:56.430119 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.430109    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb5b4571-e377-4ef6-b43d-3761547f6b07-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:21:56.430119 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:56.430120    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb5b4571-e377-4ef6-b43d-3761547f6b07-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:21:57.193360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:57.193327    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"
Jul 15 17:21:57.193360 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:57.193350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc" event={"ID":"cb5b4571-e377-4ef6-b43d-3761547f6b07","Type":"ContainerDied","Data":"21ef1000c846a70aa455acaa5bbd072b55742aba0cc8c530f1554ce47a7aea94"}
Jul 15 17:21:57.193623 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:57.193423    2575 scope.go:117] "RemoveContainer" containerID="0d9e016225ef51746c21d725442e795636d5a2c649cf94061363fc175f88349b"
Jul 15 17:21:57.216127 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:57.216096    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"]
Jul 15 17:21:57.222631 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:57.222605    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-29071b-94fbd7dcf-9phxc"]
Jul 15 17:21:58.024061 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:21:58.024027    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb5b4571-e377-4ef6-b43d-3761547f6b07" path="/var/lib/kubelet/pods/cb5b4571-e377-4ef6-b43d-3761547f6b07/volumes"
Jul 15 17:22:00.745442 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:00.745414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:06.507813 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:06.507717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:06.570343 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:06.570307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:11.419966 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:11.419931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:11.648175 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:11.648137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:22.157077 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.157041    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"]
Jul 15 17:22:22.157707 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.157287    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl" podUID="ede33860-da18-442a-a159-586f58748bae" containerName="maas-api" containerID="cri-o://a9da2dcba5b2261951dbb097bc523f88dbb2804f15944daba066c89e5d6e1757" gracePeriod=30
Jul 15 17:22:22.180250 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.180220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:22.314224 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.314191    2575 generic.go:356] "Generic (PLEG): container finished" podID="ede33860-da18-442a-a159-586f58748bae" containerID="a9da2dcba5b2261951dbb097bc523f88dbb2804f15944daba066c89e5d6e1757" exitCode=0
Jul 15 17:22:22.314224 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.314236    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl" event={"ID":"ede33860-da18-442a-a159-586f58748bae","Type":"ContainerDied","Data":"a9da2dcba5b2261951dbb097bc523f88dbb2804f15944daba066c89e5d6e1757"}
Jul 15 17:22:22.411964 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.411894    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:22:22.483453 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.483421    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dp6l\" (UniqueName: \"kubernetes.io/projected/ede33860-da18-442a-a159-586f58748bae-kube-api-access-4dp6l\") pod \"ede33860-da18-442a-a159-586f58748bae\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") "
Jul 15 17:22:22.483615 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.483469    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede33860-da18-442a-a159-586f58748bae-openshift-service-ca\") pod \"ede33860-da18-442a-a159-586f58748bae\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") "
Jul 15 17:22:22.483615 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.483499    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede33860-da18-442a-a159-586f58748bae-maas-api-tls\") pod \"ede33860-da18-442a-a159-586f58748bae\" (UID: \"ede33860-da18-442a-a159-586f58748bae\") "
Jul 15 17:22:22.483882 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.483855    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede33860-da18-442a-a159-586f58748bae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ede33860-da18-442a-a159-586f58748bae" (UID: "ede33860-da18-442a-a159-586f58748bae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:22:22.485665 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.485632    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ede33860-da18-442a-a159-586f58748bae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ede33860-da18-442a-a159-586f58748bae" (UID: "ede33860-da18-442a-a159-586f58748bae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:22:22.485665 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.485647    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede33860-da18-442a-a159-586f58748bae-kube-api-access-4dp6l" (OuterVolumeSpecName: "kube-api-access-4dp6l") pod "ede33860-da18-442a-a159-586f58748bae" (UID: "ede33860-da18-442a-a159-586f58748bae"). InnerVolumeSpecName "kube-api-access-4dp6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:22:22.585038 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.585003    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dp6l\" (UniqueName: \"kubernetes.io/projected/ede33860-da18-442a-a159-586f58748bae-kube-api-access-4dp6l\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:22:22.585038 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.585034    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede33860-da18-442a-a159-586f58748bae-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:22:22.585038 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:22.585045    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede33860-da18-442a-a159-586f58748bae-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:22:23.321031 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:23.321001    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"
Jul 15 17:22:23.321523 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:23.321032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl" event={"ID":"ede33860-da18-442a-a159-586f58748bae","Type":"ContainerDied","Data":"52a722e47ecdf982fd97c958066664179a2ec8007ccd5a3069eb3216c18219e6"}
Jul 15 17:22:23.321523 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:23.321099    2575 scope.go:117] "RemoveContainer" containerID="a9da2dcba5b2261951dbb097bc523f88dbb2804f15944daba066c89e5d6e1757"
Jul 15 17:22:23.343479 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:23.343441    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"]
Jul 15 17:22:23.344762 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:23.344740    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-714199-64ffc8c4fd-p69gl"]
Jul 15 17:22:24.024038 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:24.024004    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede33860-da18-442a-a159-586f58748bae" path="/var/lib/kubelet/pods/ede33860-da18-442a-a159-586f58748bae/volumes"
Jul 15 17:22:26.841964 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:26.841930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:32.654316 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:32.654280    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:32.754288 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:32.754252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:37.504782 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:37.504742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:37.755521 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:37.755437    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:38.093570 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:38.093533    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:38.412430 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:38.412338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:38.596220 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:38.596174    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:41.513895 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.513806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:41.588126 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588087    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"]
Jul 15 17:22:41.588507 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588481    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede33860-da18-442a-a159-586f58748bae" containerName="maas-api"
Jul 15 17:22:41.588507 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588504    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede33860-da18-442a-a159-586f58748bae" containerName="maas-api"
Jul 15 17:22:41.588658 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588544    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb5b4571-e377-4ef6-b43d-3761547f6b07" containerName="maas-api"
Jul 15 17:22:41.588658 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588555    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb5b4571-e377-4ef6-b43d-3761547f6b07" containerName="maas-api"
Jul 15 17:22:41.588658 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588623    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb5b4571-e377-4ef6-b43d-3761547f6b07" containerName="maas-api"
Jul 15 17:22:41.588658 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.588635    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede33860-da18-442a-a159-586f58748bae" containerName="maas-api"
Jul 15 17:22:41.591528 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.591506    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.594272 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.594083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-abaf36-serving-cert\""
Jul 15 17:22:41.598803 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.594660    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c44qh\""
Jul 15 17:22:41.598803 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.594892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:41.604840 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.604810    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"]
Jul 15 17:22:41.662192 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.662154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:41.766951 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.766860    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf79682-0317-4aac-951a-450375e2dfbd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.766951 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.766909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p282r\" (UniqueName: \"kubernetes.io/projected/ddf79682-0317-4aac-951a-450375e2dfbd-kube-api-access-p282r\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.767149 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.767060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.868135 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.868092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.868354 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.868144    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf79682-0317-4aac-951a-450375e2dfbd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.868354 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.868175    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p282r\" (UniqueName: \"kubernetes.io/projected/ddf79682-0317-4aac-951a-450375e2dfbd-kube-api-access-p282r\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.868354 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:22:41.868308    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-serving-cert: secret "maas-api-e2e-shared-a-abaf36-serving-cert" not found
Jul 15 17:22:41.868539 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:22:41.868384    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls podName:ddf79682-0317-4aac-951a-450375e2dfbd nodeName:}" failed. No retries permitted until 2026-07-15 17:22:42.36836619 +0000 UTC m=+2548.938241467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls") pod "maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" (UID: "ddf79682-0317-4aac-951a-450375e2dfbd") : secret "maas-api-e2e-shared-a-abaf36-serving-cert" not found
Jul 15 17:22:41.868902 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.868879    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf79682-0317-4aac-951a-450375e2dfbd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.877212 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.877189    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p282r\" (UniqueName: \"kubernetes.io/projected/ddf79682-0317-4aac-951a-450375e2dfbd-kube-api-access-p282r\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:41.954738 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:41.954705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:42.074099 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:42.074064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:42.173508 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:42.173464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:42.373892 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:42.373802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:42.376522 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:42.376482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:42.512969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:42.512924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:42.657837 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:42.657805    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"]
Jul 15 17:22:42.659825 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:22:42.659773    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf79682_0317_4aac_951a_450375e2dfbd.slice/crio-31d2e738b54d7354c9cad072e051d92e84c426f1b9970ca8457532838819c73d WatchSource:0}: Error finding container 31d2e738b54d7354c9cad072e051d92e84c426f1b9970ca8457532838819c73d: Status 404 returned error can't find the container with id 31d2e738b54d7354c9cad072e051d92e84c426f1b9970ca8457532838819c73d
Jul 15 17:22:43.413280 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:43.413245    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" event={"ID":"ddf79682-0317-4aac-951a-450375e2dfbd","Type":"ContainerStarted","Data":"dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba"}
Jul 15 17:22:43.413493 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:43.413300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" event={"ID":"ddf79682-0317-4aac-951a-450375e2dfbd","Type":"ContainerStarted","Data":"31d2e738b54d7354c9cad072e051d92e84c426f1b9970ca8457532838819c73d"}
Jul 15 17:22:43.413493 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:43.413326    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:43.432414 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:43.432366    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" podStartSLOduration=2.023001846 podStartE2EDuration="2.432350646s" totalImagesPullingTime="409.3488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:22:43.42993954 +0000 UTC m=+2549.999814839" watchObservedRunningTime="2026-07-15 17:22:43.432350646 +0000 UTC m=+2550.002225943"
Jul 15 17:22:46.006974 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:46.006931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:46.348338 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:46.348290    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:46.650131 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:46.650046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:46.787533 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:46.787499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:49.425343 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.425310    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:22:49.548768 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.548716    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:49.632433 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.632400    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"]
Jul 15 17:22:49.632958 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.632924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:49.636233 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.636212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.640105 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.640077    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1e0e66-serving-cert\""
Jul 15 17:22:49.646486 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.646460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"]
Jul 15 17:22:49.711201 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.711111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:49.741479 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.741445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc56170c-ac77-4553-b92e-f0450a9f9b1a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.741479 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.741482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.741715 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.741582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdstk\" (UniqueName: \"kubernetes.io/projected/bc56170c-ac77-4553-b92e-f0450a9f9b1a-kube-api-access-cdstk\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.842303 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.842261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc56170c-ac77-4553-b92e-f0450a9f9b1a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.842473 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.842313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.842473 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.842414    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdstk\" (UniqueName: \"kubernetes.io/projected/bc56170c-ac77-4553-b92e-f0450a9f9b1a-kube-api-access-cdstk\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.842574 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:22:49.842483    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-serving-cert: secret "maas-api-e2e-shared-b-1e0e66-serving-cert" not found
Jul 15 17:22:49.842574 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:22:49.842565    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls podName:bc56170c-ac77-4553-b92e-f0450a9f9b1a nodeName:}" failed. No retries permitted until 2026-07-15 17:22:50.342543045 +0000 UTC m=+2556.912418320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls") pod "maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" (UID: "bc56170c-ac77-4553-b92e-f0450a9f9b1a") : secret "maas-api-e2e-shared-b-1e0e66-serving-cert" not found
Jul 15 17:22:49.843024 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.843008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc56170c-ac77-4553-b92e-f0450a9f9b1a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:49.851175 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:49.851150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdstk\" (UniqueName: \"kubernetes.io/projected/bc56170c-ac77-4553-b92e-f0450a9f9b1a-kube-api-access-cdstk\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:50.304146 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:50.304108    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:50.347406 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:50.347364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:50.349902 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:50.349882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls\") pod \"maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:50.405948 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:50.405911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:50.548835 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:50.548764    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:50.684834 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:50.684780    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"]
Jul 15 17:22:50.688390 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:22:50.688365    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc56170c_ac77_4553_b92e_f0450a9f9b1a.slice/crio-09f6b7ce43765195d7a3b3ac4117c89469ee92530509c59c14e547c9547cd743 WatchSource:0}: Error finding container 09f6b7ce43765195d7a3b3ac4117c89469ee92530509c59c14e547c9547cd743: Status 404 returned error can't find the container with id 09f6b7ce43765195d7a3b3ac4117c89469ee92530509c59c14e547c9547cd743
Jul 15 17:22:51.453572 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:51.453469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" event={"ID":"bc56170c-ac77-4553-b92e-f0450a9f9b1a","Type":"ContainerStarted","Data":"6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9"}
Jul 15 17:22:51.453572 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:51.453532    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" event={"ID":"bc56170c-ac77-4553-b92e-f0450a9f9b1a","Type":"ContainerStarted","Data":"09f6b7ce43765195d7a3b3ac4117c89469ee92530509c59c14e547c9547cd743"}
Jul 15 17:22:51.453818 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:51.453577    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:22:51.470802 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:51.470730    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" podStartSLOduration=2.038769174 podStartE2EDuration="2.470714542s" totalImagesPullingTime="431.945368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:22:51.469107447 +0000 UTC m=+2558.038982755" watchObservedRunningTime="2026-07-15 17:22:51.470714542 +0000 UTC m=+2558.040589838"
Jul 15 17:22:54.068040 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:54.067967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:22:57.468065 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:22:57.468039    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:23:00.188949 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:00.188909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:02.741838 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:02.741798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:02.876249 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:02.876204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:02.978015 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:02.977980    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:05.860682 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:05.860643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:05.912935 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:05.912903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:09.055909 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.055875    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"]
Jul 15 17:23:09.059721 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.059697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.062798 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.062747    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"openshift-service-ca.crt\""
Jul 15 17:23:09.064091 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.064062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"auth-test-model-abaf36-kserve-self-signed-certs\""
Jul 15 17:23:09.064091 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.064089    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"default-dockercfg-nzb7n\""
Jul 15 17:23:09.064270 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.064107    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-abaf36\"/\"kube-root-ca.crt\""
Jul 15 17:23:09.069204 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.069184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"]
Jul 15 17:23:09.085905 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.085868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:09.128021 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.127985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-dshm\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.128203 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.128027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-home\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.128203 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.128047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkm2\" (UniqueName: \"kubernetes.io/projected/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-kube-api-access-6jkm2\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.128203 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.128178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-model-cache\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.128316 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.128217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tmp-dir\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.128316 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.128252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tls-certs\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229342 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-model-cache\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229543 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tmp-dir\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229543 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tls-certs\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229543 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-dshm\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229543 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229449    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-home\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229543 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkm2\" (UniqueName: \"kubernetes.io/projected/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-kube-api-access-6jkm2\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229848 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-model-cache\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229921 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229835    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tmp-dir\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.229921 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.229885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-home\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.231840 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.231815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-dshm\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.232086 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.232071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tls-certs\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.237300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.237279    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkm2\" (UniqueName: \"kubernetes.io/projected/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-kube-api-access-6jkm2\") pod \"auth-test-model-abaf36-kserve-68549df95f-sv29s\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") " pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.371520 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.371483    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:09.508605 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.508570    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"]
Jul 15 17:23:09.510573 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:23:09.510543    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e7a94f1_9ea5_4e37_84dd_a90e13fcdf9f.slice/crio-4626c8b28209e8d4774fdacf86aeeaaba1b7bb54190279d49e64a7235e23c0c8 WatchSource:0}: Error finding container 4626c8b28209e8d4774fdacf86aeeaaba1b7bb54190279d49e64a7235e23c0c8: Status 404 returned error can't find the container with id 4626c8b28209e8d4774fdacf86aeeaaba1b7bb54190279d49e64a7235e23c0c8
Jul 15 17:23:09.545160 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:09.545126    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s" event={"ID":"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f","Type":"ContainerStarted","Data":"4626c8b28209e8d4774fdacf86aeeaaba1b7bb54190279d49e64a7235e23c0c8"}
Jul 15 17:23:10.552010 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:10.551970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s" event={"ID":"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f","Type":"ContainerStarted","Data":"f548a478761a4fe921024d1b2ff1754e3ba7a388adcf660549ff7cace3d1f8e7"}
Jul 15 17:23:10.569551 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:10.569496    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s" podStartSLOduration=1.569478913 podStartE2EDuration="1.569478913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:23:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:23:10.568051681 +0000 UTC m=+2577.137927004" watchObservedRunningTime="2026-07-15 17:23:10.569478913 +0000 UTC m=+2577.139354208"
Jul 15 17:23:11.814300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:11.814264    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:11.914352 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:11.914310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:23:19.372213 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:19.372156    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:19.372213 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:19.372226    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:19.385104 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:19.385068    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:19.608046 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:19.608017    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:23:40.979195 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:23:40.979107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:24:23.654943 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:24:23.654905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:24:42.262066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:24:42.262016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:25:14.083810 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:25:14.083705    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:25:14.099663 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:25:14.099639    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:25:49.148245 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:25:49.148207    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"]
Jul 15 17:25:49.164194 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:25:49.164159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:25:50.661501 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:25:50.661469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:26:04.168826 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.168760    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s" podUID="8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" containerName="main" containerID="cri-o://f548a478761a4fe921024d1b2ff1754e3ba7a388adcf660549ff7cace3d1f8e7" gracePeriod=45
Jul 15 17:26:04.386783 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.386750    2575 generic.go:356] "Generic (PLEG): container finished" podID="8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" containerID="f548a478761a4fe921024d1b2ff1754e3ba7a388adcf660549ff7cace3d1f8e7" exitCode=0
Jul 15 17:26:04.387007 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.386814    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s" event={"ID":"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f","Type":"ContainerDied","Data":"f548a478761a4fe921024d1b2ff1754e3ba7a388adcf660549ff7cace3d1f8e7"}
Jul 15 17:26:04.420527 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.420451    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:26:04.591721 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.591677    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-model-cache\") pod \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") "
Jul 15 17:26:04.591721 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.591729    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-dshm\") pod \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") "
Jul 15 17:26:04.592026 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.591757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-home\") pod \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") "
Jul 15 17:26:04.592026 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.591779    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tmp-dir\") pod \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") "
Jul 15 17:26:04.592026 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.591885    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jkm2\" (UniqueName: \"kubernetes.io/projected/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-kube-api-access-6jkm2\") pod \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") "
Jul 15 17:26:04.592026 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.591908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tls-certs\") pod \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\" (UID: \"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f\") "
Jul 15 17:26:04.592240 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.592061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" (UID: "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:04.592240 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.592083    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-home" (OuterVolumeSpecName: "home") pod "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" (UID: "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:04.592240 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.592101    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" (UID: "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:04.592240 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.592191    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-model-cache\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:26:04.592240 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.592211    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-home\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:26:04.592240 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.592226    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tmp-dir\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:26:04.594134 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.594103    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-dshm" (OuterVolumeSpecName: "dshm") pod "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" (UID: "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:26:04.594259 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.594178    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-kube-api-access-6jkm2" (OuterVolumeSpecName: "kube-api-access-6jkm2") pod "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" (UID: "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f"). InnerVolumeSpecName "kube-api-access-6jkm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:26:04.594259 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.594184    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" (UID: "8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:26:04.693559 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.693451    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jkm2\" (UniqueName: \"kubernetes.io/projected/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-kube-api-access-6jkm2\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:26:04.693559 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.693495    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-tls-certs\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:26:04.693559 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:04.693506    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f-dshm\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:26:05.393875 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:05.393842    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"
Jul 15 17:26:05.394375 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:05.393843    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s" event={"ID":"8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f","Type":"ContainerDied","Data":"4626c8b28209e8d4774fdacf86aeeaaba1b7bb54190279d49e64a7235e23c0c8"}
Jul 15 17:26:05.394375 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:05.393968    2575 scope.go:117] "RemoveContainer" containerID="f548a478761a4fe921024d1b2ff1754e3ba7a388adcf660549ff7cace3d1f8e7"
Jul 15 17:26:05.413960 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:05.413931    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"]
Jul 15 17:26:05.419779 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:05.419753    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-abaf36/auth-test-model-abaf36-kserve-68549df95f-sv29s"]
Jul 15 17:26:06.024807 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:06.024763    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" path="/var/lib/kubelet/pods/8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f/volumes"
Jul 15 17:26:16.456546 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:16.456505    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:26:38.319854 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.319747    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"]
Jul 15 17:26:38.320392 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.320249    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" containerName="main"
Jul 15 17:26:38.320392 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.320272    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" containerName="main"
Jul 15 17:26:38.320531 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.320432    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e7a94f1-9ea5-4e37-84dd-a90e13fcdf9f" containerName="main"
Jul 15 17:26:38.323676 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.323651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.327372 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.327346    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"kube-root-ca.crt\""
Jul 15 17:26:38.327620 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.327362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"sub-test-model-1e0e66-kserve-self-signed-certs\""
Jul 15 17:26:38.327828 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.327382    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"default-dockercfg-p9fzq\""
Jul 15 17:26:38.328038 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.327386    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"openshift-service-ca.crt\""
Jul 15 17:26:38.333069 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.332535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"]
Jul 15 17:26:38.355168 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.355134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:26:38.410368 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.410329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-tmp-dir\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.410563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.410381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-model-cache\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.410563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.410462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d18c64-0a51-4a36-9943-f32a446ef84a-tls-certs\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.410563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.410504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9wb\" (UniqueName: \"kubernetes.io/projected/34d18c64-0a51-4a36-9943-f32a446ef84a-kube-api-access-4d9wb\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.410563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.410546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-dshm\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.410725 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.410588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-home\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511271 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-model-cache\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511271 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d18c64-0a51-4a36-9943-f32a446ef84a-tls-certs\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9wb\" (UniqueName: \"kubernetes.io/projected/34d18c64-0a51-4a36-9943-f32a446ef84a-kube-api-access-4d9wb\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-dshm\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-home\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511540 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-tmp-dir\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511744 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-model-cache\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511858 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511836    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-home\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.511901 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.511860    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-tmp-dir\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.513604 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.513584    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-dshm\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.513882 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.513864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d18c64-0a51-4a36-9943-f32a446ef84a-tls-certs\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.518660 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.518638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9wb\" (UniqueName: \"kubernetes.io/projected/34d18c64-0a51-4a36-9943-f32a446ef84a-kube-api-access-4d9wb\") pod \"sub-test-model-1e0e66-kserve-6d8448c745-9h8hl\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") " pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.636366 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.636328    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:38.770064 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:38.770028    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"]
Jul 15 17:26:38.773211 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:26:38.773176    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34d18c64_0a51_4a36_9943_f32a446ef84a.slice/crio-5b9176591d87157d0057b278c6ffbd928329689e5555da1e6e550b9c6acf78f1 WatchSource:0}: Error finding container 5b9176591d87157d0057b278c6ffbd928329689e5555da1e6e550b9c6acf78f1: Status 404 returned error can't find the container with id 5b9176591d87157d0057b278c6ffbd928329689e5555da1e6e550b9c6acf78f1
Jul 15 17:26:39.565477 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:39.565435    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl" event={"ID":"34d18c64-0a51-4a36-9943-f32a446ef84a","Type":"ContainerStarted","Data":"d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73"}
Jul 15 17:26:39.565907 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:39.565489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl" event={"ID":"34d18c64-0a51-4a36-9943-f32a446ef84a","Type":"ContainerStarted","Data":"5b9176591d87157d0057b278c6ffbd928329689e5555da1e6e550b9c6acf78f1"}
Jul 15 17:26:39.582544 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:39.582483    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl" podStartSLOduration=1.582464965 podStartE2EDuration="1.582464965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:26:39.580696335 +0000 UTC m=+2786.150571631" watchObservedRunningTime="2026-07-15 17:26:39.582464965 +0000 UTC m=+2786.152340262"
Jul 15 17:26:45.569470 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:45.569430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:26:45.671017 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:45.670986    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:26:48.637247 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:48.637203    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:48.637734 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:48.637274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:48.650258 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:48.650232    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:26:49.624370 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:26:49.624335    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:27:17.940485 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:17.940444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:27:18.814228 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:18.814188    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"]
Jul 15 17:27:18.832156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:18.832123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:27:21.765244 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:21.765208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:27:33.835023 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:33.834976    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl" podUID="34d18c64-0a51-4a36-9943-f32a446ef84a" containerName="main" containerID="cri-o://d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73" gracePeriod=45
Jul 15 17:27:34.096796 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.096711    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:27:34.239937 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.239898    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-model-cache\") pod \"34d18c64-0a51-4a36-9943-f32a446ef84a\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") "
Jul 15 17:27:34.239937 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.239945    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d9wb\" (UniqueName: \"kubernetes.io/projected/34d18c64-0a51-4a36-9943-f32a446ef84a-kube-api-access-4d9wb\") pod \"34d18c64-0a51-4a36-9943-f32a446ef84a\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") "
Jul 15 17:27:34.240201 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.239996    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-dshm\") pod \"34d18c64-0a51-4a36-9943-f32a446ef84a\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") "
Jul 15 17:27:34.240201 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240016    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-tmp-dir\") pod \"34d18c64-0a51-4a36-9943-f32a446ef84a\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") "
Jul 15 17:27:34.240201 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240040    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d18c64-0a51-4a36-9943-f32a446ef84a-tls-certs\") pod \"34d18c64-0a51-4a36-9943-f32a446ef84a\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") "
Jul 15 17:27:34.240201 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240087    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-home\") pod \"34d18c64-0a51-4a36-9943-f32a446ef84a\" (UID: \"34d18c64-0a51-4a36-9943-f32a446ef84a\") "
Jul 15 17:27:34.240415 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240220    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-model-cache" (OuterVolumeSpecName: "model-cache") pod "34d18c64-0a51-4a36-9943-f32a446ef84a" (UID: "34d18c64-0a51-4a36-9943-f32a446ef84a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:34.240415 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240326    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34d18c64-0a51-4a36-9943-f32a446ef84a" (UID: "34d18c64-0a51-4a36-9943-f32a446ef84a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:34.240415 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240364    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-home" (OuterVolumeSpecName: "home") pod "34d18c64-0a51-4a36-9943-f32a446ef84a" (UID: "34d18c64-0a51-4a36-9943-f32a446ef84a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:34.240415 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.240394    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-model-cache\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.242400 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.242376    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-dshm" (OuterVolumeSpecName: "dshm") pod "34d18c64-0a51-4a36-9943-f32a446ef84a" (UID: "34d18c64-0a51-4a36-9943-f32a446ef84a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:27:34.242517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.242423    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d18c64-0a51-4a36-9943-f32a446ef84a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34d18c64-0a51-4a36-9943-f32a446ef84a" (UID: "34d18c64-0a51-4a36-9943-f32a446ef84a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:27:34.242517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.242433    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34d18c64-0a51-4a36-9943-f32a446ef84a-kube-api-access-4d9wb" (OuterVolumeSpecName: "kube-api-access-4d9wb") pod "34d18c64-0a51-4a36-9943-f32a446ef84a" (UID: "34d18c64-0a51-4a36-9943-f32a446ef84a"). InnerVolumeSpecName "kube-api-access-4d9wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:27:34.341325 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.341282    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d9wb\" (UniqueName: \"kubernetes.io/projected/34d18c64-0a51-4a36-9943-f32a446ef84a-kube-api-access-4d9wb\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.341325 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.341317    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-dshm\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.341325 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.341329    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-tmp-dir\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.341325 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.341338    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d18c64-0a51-4a36-9943-f32a446ef84a-tls-certs\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.341615 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.341345    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d18c64-0a51-4a36-9943-f32a446ef84a-home\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:27:34.830624 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.830583    2575 generic.go:356] "Generic (PLEG): container finished" podID="34d18c64-0a51-4a36-9943-f32a446ef84a" containerID="d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73" exitCode=0
Jul 15 17:27:34.830624 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.830626    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"
Jul 15 17:27:34.830923 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.830637    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl" event={"ID":"34d18c64-0a51-4a36-9943-f32a446ef84a","Type":"ContainerDied","Data":"d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73"}
Jul 15 17:27:34.830923 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.830670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl" event={"ID":"34d18c64-0a51-4a36-9943-f32a446ef84a","Type":"ContainerDied","Data":"5b9176591d87157d0057b278c6ffbd928329689e5555da1e6e550b9c6acf78f1"}
Jul 15 17:27:34.830923 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.830686    2575 scope.go:117] "RemoveContainer" containerID="d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73"
Jul 15 17:27:34.840608 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.840456    2575 scope.go:117] "RemoveContainer" containerID="d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73"
Jul 15 17:27:34.840850 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:27:34.840747    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73\": container with ID starting with d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73 not found: ID does not exist" containerID="d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73"
Jul 15 17:27:34.840850 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.840774    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73"} err="failed to get container status \"d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73\": rpc error: code = NotFound desc = could not find container \"d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73\": container with ID starting with d7d69a491f18b806b6a56153fd34e0be3cfe15959a616c888b5e22f3a41b3c73 not found: ID does not exist"
Jul 15 17:27:34.851688 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.851658    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"]
Jul 15 17:27:34.853432 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:34.853412    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/sub-test-model-1e0e66-kserve-6d8448c745-9h8hl"]
Jul 15 17:27:36.024245 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:36.024208    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34d18c64-0a51-4a36-9943-f32a446ef84a" path="/var/lib/kubelet/pods/34d18c64-0a51-4a36-9943-f32a446ef84a/volumes"
Jul 15 17:27:52.634246 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.634210    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"]
Jul 15 17:27:52.636756 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.634577    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d18c64-0a51-4a36-9943-f32a446ef84a" containerName="main"
Jul 15 17:27:52.636756 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.634589    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d18c64-0a51-4a36-9943-f32a446ef84a" containerName="main"
Jul 15 17:27:52.636756 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.634654    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d18c64-0a51-4a36-9943-f32a446ef84a" containerName="main"
Jul 15 17:27:52.637661 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.637643    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.641349 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.641317    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"openshift-service-ca.crt\""
Jul 15 17:27:52.641502 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.641360    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"kube-root-ca.crt\""
Jul 15 17:27:52.641502 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.641375    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"default-dockercfg-p9fzq\""
Jul 15 17:27:52.641502 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.641330    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e0e66\"/\"rate-test-model-1e0e66-kserve-self-signed-certs\""
Jul 15 17:27:52.646892 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.646871    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"]
Jul 15 17:27:52.664860 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.664826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:27:52.696165 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.696125    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-home\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.696377 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.696186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tls-certs\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.696377 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.696211    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tmp-dir\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.696377 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.696277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-model-cache\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.696526 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.696401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wrp\" (UniqueName: \"kubernetes.io/projected/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-kube-api-access-h2wrp\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.696526 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.696434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-dshm\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.797611 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.797573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tls-certs\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.797611 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.797612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tmp-dir\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.797926 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.797631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-model-cache\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.797926 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.797676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wrp\" (UniqueName: \"kubernetes.io/projected/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-kube-api-access-h2wrp\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.797926 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.797814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-dshm\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.797926 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.797882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-home\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.798167 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.798082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tmp-dir\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.798167 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.798100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-model-cache\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.798243 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.798182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-home\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.799970 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.799935    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-dshm\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.800339 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.800318    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tls-certs\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.805397 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.805363    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wrp\" (UniqueName: \"kubernetes.io/projected/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-kube-api-access-h2wrp\") pod \"rate-test-model-1e0e66-kserve-5b77fd7987-8456z\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") " pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:52.947856 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:52.947721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:27:53.083544 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:53.083519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"]
Jul 15 17:27:53.085559 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:27:53.085529    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc8ae56f_2ea0_45a3_bf2b_7d4019432aa6.slice/crio-d39c3eb67573d5d2994b79ff10082ed47eddddf1083c0cf9ab31b4c1abeac953 WatchSource:0}: Error finding container d39c3eb67573d5d2994b79ff10082ed47eddddf1083c0cf9ab31b4c1abeac953: Status 404 returned error can't find the container with id d39c3eb67573d5d2994b79ff10082ed47eddddf1083c0cf9ab31b4c1abeac953
Jul 15 17:27:53.925004 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:53.924964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z" event={"ID":"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6","Type":"ContainerStarted","Data":"d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a"}
Jul 15 17:27:53.925004 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:53.925011    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z" event={"ID":"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6","Type":"ContainerStarted","Data":"d39c3eb67573d5d2994b79ff10082ed47eddddf1083c0cf9ab31b4c1abeac953"}
Jul 15 17:27:53.942385 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:27:53.942324    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z" podStartSLOduration=1.942305189 podStartE2EDuration="1.942305189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:27:53.940911482 +0000 UTC m=+2860.510786778" watchObservedRunningTime="2026-07-15 17:27:53.942305189 +0000 UTC m=+2860.512180486"
Jul 15 17:28:02.948340 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:02.948300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:28:02.948340 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:02.948347    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:28:02.961061 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:02.961028    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:28:02.981102 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:02.981069    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:28:03.592743 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:03.592706    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:03.693489 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:03.693451    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:12.791059 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:12.790963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:12.889877 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:12.889845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:21.101265 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:21.101233    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:21.202632 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:21.202599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:34.775143 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:34.775104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:35.735453 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:35.735416    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"]
Jul 15 17:28:35.757560 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:35.757521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:36.714913 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.714874    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-139836660541744"]
Jul 15 17:28:36.718744 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.718718    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:36.721008 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.720984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kmfwn\""
Jul 15 17:28:36.725611 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.725584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660541744"]
Jul 15 17:28:36.817478 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.817444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgh6\" (UniqueName: \"kubernetes.io/projected/08f1a82f-e3bb-4652-9f26-295aa1bd7583-kube-api-access-rzgh6\") pod \"test-curl-7542-139836660541744\" (UID: \"08f1a82f-e3bb-4652-9f26-295aa1bd7583\") " pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:36.917966 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.917929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgh6\" (UniqueName: \"kubernetes.io/projected/08f1a82f-e3bb-4652-9f26-295aa1bd7583-kube-api-access-rzgh6\") pod \"test-curl-7542-139836660541744\" (UID: \"08f1a82f-e3bb-4652-9f26-295aa1bd7583\") " pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:36.925756 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:36.925725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgh6\" (UniqueName: \"kubernetes.io/projected/08f1a82f-e3bb-4652-9f26-295aa1bd7583-kube-api-access-rzgh6\") pod \"test-curl-7542-139836660541744\" (UID: \"08f1a82f-e3bb-4652-9f26-295aa1bd7583\") " pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:37.029997 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:37.029896    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:37.167251 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:37.167200    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660541744"]
Jul 15 17:28:37.170356 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:28:37.170325    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08f1a82f_e3bb_4652_9f26_295aa1bd7583.slice/crio-ccc9bc7f2db23929a54284e1dd8e976372bc3f729fb554e56cc37ab61fc6c26a WatchSource:0}: Error finding container ccc9bc7f2db23929a54284e1dd8e976372bc3f729fb554e56cc37ab61fc6c26a: Status 404 returned error can't find the container with id ccc9bc7f2db23929a54284e1dd8e976372bc3f729fb554e56cc37ab61fc6c26a
Jul 15 17:28:37.171609 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:37.171587    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 17:28:38.145536 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:38.145433    2575 generic.go:356] "Generic (PLEG): container finished" podID="08f1a82f-e3bb-4652-9f26-295aa1bd7583" containerID="0829ee96c5f22b66b43d459aaefa2435003cb34e6d35fd2ab114f3b557fc4d5d" exitCode=0
Jul 15 17:28:38.145536 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:38.145516    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660541744" event={"ID":"08f1a82f-e3bb-4652-9f26-295aa1bd7583","Type":"ContainerDied","Data":"0829ee96c5f22b66b43d459aaefa2435003cb34e6d35fd2ab114f3b557fc4d5d"}
Jul 15 17:28:38.146033 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:38.145562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660541744" event={"ID":"08f1a82f-e3bb-4652-9f26-295aa1bd7583","Type":"ContainerStarted","Data":"ccc9bc7f2db23929a54284e1dd8e976372bc3f729fb554e56cc37ab61fc6c26a"}
Jul 15 17:28:39.284265 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.284238    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:39.303949 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.303915    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7542-139836660541744_08f1a82f-e3bb-4652-9f26-295aa1bd7583/test-curl-7542-139836660541744/0.log"
Jul 15 17:28:39.329411 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.329376    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-139836660541744"]
Jul 15 17:28:39.332544 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.332511    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-139836660541744"]
Jul 15 17:28:39.336885 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.336863    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzgh6\" (UniqueName: \"kubernetes.io/projected/08f1a82f-e3bb-4652-9f26-295aa1bd7583-kube-api-access-rzgh6\") pod \"08f1a82f-e3bb-4652-9f26-295aa1bd7583\" (UID: \"08f1a82f-e3bb-4652-9f26-295aa1bd7583\") "
Jul 15 17:28:39.339079 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.339056    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f1a82f-e3bb-4652-9f26-295aa1bd7583-kube-api-access-rzgh6" (OuterVolumeSpecName: "kube-api-access-rzgh6") pod "08f1a82f-e3bb-4652-9f26-295aa1bd7583" (UID: "08f1a82f-e3bb-4652-9f26-295aa1bd7583"). InnerVolumeSpecName "kube-api-access-rzgh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:39.438379 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:39.438292    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzgh6\" (UniqueName: \"kubernetes.io/projected/08f1a82f-e3bb-4652-9f26-295aa1bd7583-kube-api-access-rzgh6\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:40.024385 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:40.024349    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f1a82f-e3bb-4652-9f26-295aa1bd7583" path="/var/lib/kubelet/pods/08f1a82f-e3bb-4652-9f26-295aa1bd7583/volumes"
Jul 15 17:28:40.156208 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:40.156176    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660541744"
Jul 15 17:28:40.156208 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:40.156211    2575 scope.go:117] "RemoveContainer" containerID="0829ee96c5f22b66b43d459aaefa2435003cb34e6d35fd2ab114f3b557fc4d5d"
Jul 15 17:28:42.862958 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.862918    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:42.863365 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.863332    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f1a82f-e3bb-4652-9f26-295aa1bd7583" containerName="test-curl-7542-139836660541744"
Jul 15 17:28:42.863365 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.863346    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f1a82f-e3bb-4652-9f26-295aa1bd7583" containerName="test-curl-7542-139836660541744"
Jul 15 17:28:42.863448 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.863435    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f1a82f-e3bb-4652-9f26-295aa1bd7583" containerName="test-curl-7542-139836660541744"
Jul 15 17:28:42.867758 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.867738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:42.870713 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.870682    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kmfwn\""
Jul 15 17:28:42.871974 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.871943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:42.972229 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:42.972188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jk95\" (UniqueName: \"kubernetes.io/projected/586b0670-d69c-49f8-9fdf-550ca4315b89-kube-api-access-8jk95\") pod \"test-curl-7542-139836660666416\" (UID: \"586b0670-d69c-49f8-9fdf-550ca4315b89\") " pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:43.073473 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:43.073427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jk95\" (UniqueName: \"kubernetes.io/projected/586b0670-d69c-49f8-9fdf-550ca4315b89-kube-api-access-8jk95\") pod \"test-curl-7542-139836660666416\" (UID: \"586b0670-d69c-49f8-9fdf-550ca4315b89\") " pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:43.080896 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:43.080864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jk95\" (UniqueName: \"kubernetes.io/projected/586b0670-d69c-49f8-9fdf-550ca4315b89-kube-api-access-8jk95\") pod \"test-curl-7542-139836660666416\" (UID: \"586b0670-d69c-49f8-9fdf-550ca4315b89\") " pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:43.179366 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:43.179259    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:43.522163 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:43.522129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:43.524158 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:28:43.524130    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod586b0670_d69c_49f8_9fdf_550ca4315b89.slice/crio-6f90c155a046f7cd7498e2b7e00df05e2858931ea1aec4734eb8487b367fd424 WatchSource:0}: Error finding container 6f90c155a046f7cd7498e2b7e00df05e2858931ea1aec4734eb8487b367fd424: Status 404 returned error can't find the container with id 6f90c155a046f7cd7498e2b7e00df05e2858931ea1aec4734eb8487b367fd424
Jul 15 17:28:44.179969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:44.179862    2575 generic.go:356] "Generic (PLEG): container finished" podID="586b0670-d69c-49f8-9fdf-550ca4315b89" containerID="9b312708ac658f238513d4ea3cdb927be35345a775722bd1927559df7481e282" exitCode=0
Jul 15 17:28:44.179969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:44.179948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660666416" event={"ID":"586b0670-d69c-49f8-9fdf-550ca4315b89","Type":"ContainerDied","Data":"9b312708ac658f238513d4ea3cdb927be35345a775722bd1927559df7481e282"}
Jul 15 17:28:44.180418 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:44.179991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660666416" event={"ID":"586b0670-d69c-49f8-9fdf-550ca4315b89","Type":"ContainerStarted","Data":"6f90c155a046f7cd7498e2b7e00df05e2858931ea1aec4734eb8487b367fd424"}
Jul 15 17:28:45.323001 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.322969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:45.342564 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.342534    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7542-139836660666416_586b0670-d69c-49f8-9fdf-550ca4315b89/test-curl-7542-139836660666416/0.log"
Jul 15 17:28:45.370475 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.370428    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:45.372333 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.372305    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-139836660666416"]
Jul 15 17:28:45.396866 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.396783    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jk95\" (UniqueName: \"kubernetes.io/projected/586b0670-d69c-49f8-9fdf-550ca4315b89-kube-api-access-8jk95\") pod \"586b0670-d69c-49f8-9fdf-550ca4315b89\" (UID: \"586b0670-d69c-49f8-9fdf-550ca4315b89\") "
Jul 15 17:28:45.398962 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.398929    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586b0670-d69c-49f8-9fdf-550ca4315b89-kube-api-access-8jk95" (OuterVolumeSpecName: "kube-api-access-8jk95") pod "586b0670-d69c-49f8-9fdf-550ca4315b89" (UID: "586b0670-d69c-49f8-9fdf-550ca4315b89"). InnerVolumeSpecName "kube-api-access-8jk95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:45.497989 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:45.497908    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jk95\" (UniqueName: \"kubernetes.io/projected/586b0670-d69c-49f8-9fdf-550ca4315b89-kube-api-access-8jk95\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:46.023899 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:46.023862    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="586b0670-d69c-49f8-9fdf-550ca4315b89" path="/var/lib/kubelet/pods/586b0670-d69c-49f8-9fdf-550ca4315b89/volumes"
Jul 15 17:28:46.192343 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:46.192312    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660666416"
Jul 15 17:28:46.192529 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:46.192381    2575 scope.go:117] "RemoveContainer" containerID="9b312708ac658f238513d4ea3cdb927be35345a775722bd1927559df7481e282"
Jul 15 17:28:47.847819 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.847768    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:47.848226 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.848134    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586b0670-d69c-49f8-9fdf-550ca4315b89" containerName="test-curl-7542-139836660666416"
Jul 15 17:28:47.848226 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.848145    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="586b0670-d69c-49f8-9fdf-550ca4315b89" containerName="test-curl-7542-139836660666416"
Jul 15 17:28:47.848300 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.848237    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="586b0670-d69c-49f8-9fdf-550ca4315b89" containerName="test-curl-7542-139836660666416"
Jul 15 17:28:47.852608 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.852588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:47.855260 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.855220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kmfwn\""
Jul 15 17:28:47.858058 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.858027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:47.923547 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:47.923506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krg2h\" (UniqueName: \"kubernetes.io/projected/a38908c8-ff69-46d5-b569-0979f2a4fc20-kube-api-access-krg2h\") pod \"test-curl-7542-139836660667424\" (UID: \"a38908c8-ff69-46d5-b569-0979f2a4fc20\") " pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:48.024815 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:48.024773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krg2h\" (UniqueName: \"kubernetes.io/projected/a38908c8-ff69-46d5-b569-0979f2a4fc20-kube-api-access-krg2h\") pod \"test-curl-7542-139836660667424\" (UID: \"a38908c8-ff69-46d5-b569-0979f2a4fc20\") " pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:48.033815 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:48.033772    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krg2h\" (UniqueName: \"kubernetes.io/projected/a38908c8-ff69-46d5-b569-0979f2a4fc20-kube-api-access-krg2h\") pod \"test-curl-7542-139836660667424\" (UID: \"a38908c8-ff69-46d5-b569-0979f2a4fc20\") " pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:48.168137 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:48.168051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:48.305112 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:48.305085    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:48.307134 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:28:48.307103    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda38908c8_ff69_46d5_b569_0979f2a4fc20.slice/crio-7164276a3f46d3ad1da4a7c69737a9fab3b8b1df776d074c17fab30d171fd7f3 WatchSource:0}: Error finding container 7164276a3f46d3ad1da4a7c69737a9fab3b8b1df776d074c17fab30d171fd7f3: Status 404 returned error can't find the container with id 7164276a3f46d3ad1da4a7c69737a9fab3b8b1df776d074c17fab30d171fd7f3
Jul 15 17:28:49.210678 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:49.210639    2575 generic.go:356] "Generic (PLEG): container finished" podID="a38908c8-ff69-46d5-b569-0979f2a4fc20" containerID="f54d6fda09a21029ed78bc45ca4a390c8438ef1d6653cec36ece0090e863c167" exitCode=0
Jul 15 17:28:49.211091 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:49.210695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660667424" event={"ID":"a38908c8-ff69-46d5-b569-0979f2a4fc20","Type":"ContainerDied","Data":"f54d6fda09a21029ed78bc45ca4a390c8438ef1d6653cec36ece0090e863c167"}
Jul 15 17:28:49.211091 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:49.210729    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7542-139836660667424" event={"ID":"a38908c8-ff69-46d5-b569-0979f2a4fc20","Type":"ContainerStarted","Data":"7164276a3f46d3ad1da4a7c69737a9fab3b8b1df776d074c17fab30d171fd7f3"}
Jul 15 17:28:50.350509 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.350482    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:50.370220 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.370191    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7542-139836660667424_a38908c8-ff69-46d5-b569-0979f2a4fc20/test-curl-7542-139836660667424/0.log"
Jul 15 17:28:50.393931 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.393897    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:50.397148 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.397118    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7542-139836660667424"]
Jul 15 17:28:50.447497 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.447463    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krg2h\" (UniqueName: \"kubernetes.io/projected/a38908c8-ff69-46d5-b569-0979f2a4fc20-kube-api-access-krg2h\") pod \"a38908c8-ff69-46d5-b569-0979f2a4fc20\" (UID: \"a38908c8-ff69-46d5-b569-0979f2a4fc20\") "
Jul 15 17:28:50.449758 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.449730    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a38908c8-ff69-46d5-b569-0979f2a4fc20-kube-api-access-krg2h" (OuterVolumeSpecName: "kube-api-access-krg2h") pod "a38908c8-ff69-46d5-b569-0979f2a4fc20" (UID: "a38908c8-ff69-46d5-b569-0979f2a4fc20"). InnerVolumeSpecName "kube-api-access-krg2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:50.548283 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.548194    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krg2h\" (UniqueName: \"kubernetes.io/projected/a38908c8-ff69-46d5-b569-0979f2a4fc20-kube-api-access-krg2h\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:50.756211 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:50.756164    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z" podUID="fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" containerName="main" containerID="cri-o://d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a" gracePeriod=45
Jul 15 17:28:51.003496 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.003465    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:28:51.153860 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.153731    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-model-cache\") pod \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") "
Jul 15 17:28:51.153860 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.153825    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tls-certs\") pod \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") "
Jul 15 17:28:51.154103 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.153889    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2wrp\" (UniqueName: \"kubernetes.io/projected/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-kube-api-access-h2wrp\") pod \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") "
Jul 15 17:28:51.154103 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.153912    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-dshm\") pod \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") "
Jul 15 17:28:51.154103 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.153945    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tmp-dir\") pod \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") "
Jul 15 17:28:51.154103 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.153997    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-home\") pod \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\" (UID: \"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6\") "
Jul 15 17:28:51.154103 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.154026    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" (UID: "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:51.154377 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.154351    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" (UID: "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:51.154432 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.154367    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-model-cache\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:51.154528 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.154510    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-home" (OuterVolumeSpecName: "home") pod "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" (UID: "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:51.156610 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.156565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-dshm" (OuterVolumeSpecName: "dshm") pod "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" (UID: "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 17:28:51.156772 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.156633    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" (UID: "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:28:51.156772 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.156659    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-kube-api-access-h2wrp" (OuterVolumeSpecName: "kube-api-access-h2wrp") pod "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" (UID: "fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6"). InnerVolumeSpecName "kube-api-access-h2wrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:28:51.222747 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.222654    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:51.222747 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.222679    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7164276a3f46d3ad1da4a7c69737a9fab3b8b1df776d074c17fab30d171fd7f3"
Jul 15 17:28:51.224530 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.224498    2575 generic.go:356] "Generic (PLEG): container finished" podID="fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" containerID="d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a" exitCode=0
Jul 15 17:28:51.224689 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.224541    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"
Jul 15 17:28:51.224689 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.224557    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z" event={"ID":"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6","Type":"ContainerDied","Data":"d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a"}
Jul 15 17:28:51.224689 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.224590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z" event={"ID":"fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6","Type":"ContainerDied","Data":"d39c3eb67573d5d2994b79ff10082ed47eddddf1083c0cf9ab31b4c1abeac953"}
Jul 15 17:28:51.224689 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.224613    2575 scope.go:117] "RemoveContainer" containerID="d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a"
Jul 15 17:28:51.235953 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.235928    2575 scope.go:117] "RemoveContainer" containerID="d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a"
Jul 15 17:28:51.236280 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:28:51.236264    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a\": container with ID starting with d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a not found: ID does not exist" containerID="d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a"
Jul 15 17:28:51.236348 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.236305    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a"} err="failed to get container status \"d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a\": rpc error: code = NotFound desc = could not find container \"d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a\": container with ID starting with d4ec12b7b64b220cff4bec1b00b2f65f6c07fb6ae6cbe6c9e26345cfa8afbd7a not found: ID does not exist"
Jul 15 17:28:51.248943 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.248902    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"]
Jul 15 17:28:51.249577 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:28:51.249548    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-139836660667424\" is forbidden: User \"system:node:ip-10-0-135-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-165.ec2.internal' and this object" podUID="a38908c8-ff69-46d5-b569-0979f2a4fc20" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:51.251264 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.251240    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e0e66/rate-test-model-1e0e66-kserve-5b77fd7987-8456z"]
Jul 15 17:28:51.251322 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:28:51.251296    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7542-139836660667424\" is forbidden: User \"system:node:ip-10-0-135-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-165.ec2.internal' and this object" podUID="a38908c8-ff69-46d5-b569-0979f2a4fc20" pod="opendatahub/test-curl-7542-139836660667424"
Jul 15 17:28:51.255766 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.255744    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tls-certs\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:51.255842 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.255770    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2wrp\" (UniqueName: \"kubernetes.io/projected/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-kube-api-access-h2wrp\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:51.255842 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.255782    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-dshm\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:51.255842 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.255808    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-tmp-dir\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:51.255842 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:51.255819    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6-home\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:28:52.023442 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:52.023404    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a38908c8-ff69-46d5-b569-0979f2a4fc20" path="/var/lib/kubelet/pods/a38908c8-ff69-46d5-b569-0979f2a4fc20/volumes"
Jul 15 17:28:52.023853 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:52.023837    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" path="/var/lib/kubelet/pods/fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6/volumes"
Jul 15 17:28:53.591066 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:53.591026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:28:53.691675 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:28:53.691643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:03.365245 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.365204    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"]
Jul 15 17:29:03.365730 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.365509    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" podUID="ddf79682-0317-4aac-951a-450375e2dfbd" containerName="maas-api" containerID="cri-o://dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba" gracePeriod=30
Jul 15 17:29:03.395211 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.395154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:03.820209 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.820177    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:29:03.871476 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.871443    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls\") pod \"ddf79682-0317-4aac-951a-450375e2dfbd\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") "
Jul 15 17:29:03.871657 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.871484    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf79682-0317-4aac-951a-450375e2dfbd-openshift-service-ca\") pod \"ddf79682-0317-4aac-951a-450375e2dfbd\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") "
Jul 15 17:29:03.871657 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.871518    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p282r\" (UniqueName: \"kubernetes.io/projected/ddf79682-0317-4aac-951a-450375e2dfbd-kube-api-access-p282r\") pod \"ddf79682-0317-4aac-951a-450375e2dfbd\" (UID: \"ddf79682-0317-4aac-951a-450375e2dfbd\") "
Jul 15 17:29:03.871962 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.871921    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf79682-0317-4aac-951a-450375e2dfbd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ddf79682-0317-4aac-951a-450375e2dfbd" (UID: "ddf79682-0317-4aac-951a-450375e2dfbd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:29:03.873712 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.873682    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ddf79682-0317-4aac-951a-450375e2dfbd" (UID: "ddf79682-0317-4aac-951a-450375e2dfbd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:29:03.873812 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.873686    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf79682-0317-4aac-951a-450375e2dfbd-kube-api-access-p282r" (OuterVolumeSpecName: "kube-api-access-p282r") pod "ddf79682-0317-4aac-951a-450375e2dfbd" (UID: "ddf79682-0317-4aac-951a-450375e2dfbd"). InnerVolumeSpecName "kube-api-access-p282r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:29:03.972174 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.972079    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddf79682-0317-4aac-951a-450375e2dfbd-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:29:03.972174 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.972111    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf79682-0317-4aac-951a-450375e2dfbd-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:29:03.972174 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:03.972122    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p282r\" (UniqueName: \"kubernetes.io/projected/ddf79682-0317-4aac-951a-450375e2dfbd-kube-api-access-p282r\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:29:04.288561 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.288465    2575 generic.go:356] "Generic (PLEG): container finished" podID="ddf79682-0317-4aac-951a-450375e2dfbd" containerID="dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba" exitCode=0
Jul 15 17:29:04.288561 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.288513    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"
Jul 15 17:29:04.288561 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.288519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" event={"ID":"ddf79682-0317-4aac-951a-450375e2dfbd","Type":"ContainerDied","Data":"dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba"}
Jul 15 17:29:04.288561 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.288562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss" event={"ID":"ddf79682-0317-4aac-951a-450375e2dfbd","Type":"ContainerDied","Data":"31d2e738b54d7354c9cad072e051d92e84c426f1b9970ca8457532838819c73d"}
Jul 15 17:29:04.288872 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.288584    2575 scope.go:117] "RemoveContainer" containerID="dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba"
Jul 15 17:29:04.297140 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.297121    2575 scope.go:117] "RemoveContainer" containerID="dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba"
Jul 15 17:29:04.297435 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:29:04.297411    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba\": container with ID starting with dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba not found: ID does not exist" containerID="dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba"
Jul 15 17:29:04.297511 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.297456    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba"} err="failed to get container status \"dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba\": rpc error: code = NotFound desc = could not find container \"dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba\": container with ID starting with dff88c69d7f5155642e98b95232b0bb8fa7b3d11274ee7c6a9af2f3d364b1cba not found: ID does not exist"
Jul 15 17:29:04.304572 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.304544    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"]
Jul 15 17:29:04.309267 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:04.309244    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-abaf36-7dc4ff4ff6-4gbss"]
Jul 15 17:29:06.023515 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:06.023479    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf79682-0317-4aac-951a-450375e2dfbd" path="/var/lib/kubelet/pods/ddf79682-0317-4aac-951a-450375e2dfbd/volumes"
Jul 15 17:29:08.356078 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:08.356039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:13.432894 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:13.432860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:13.709515 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:13.709427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:13.810123 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:13.810090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:18.709537 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:18.709502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:18.935508 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:18.935472    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:19.547654 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:19.547621    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:19.651200 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:19.651166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:29.531859 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:29.531824    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"]
Jul 15 17:29:29.532308 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:29.532089    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" podUID="bc56170c-ac77-4553-b92e-f0450a9f9b1a" containerName="maas-api" containerID="cri-o://6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9" gracePeriod=30
Jul 15 17:29:29.558543 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:29.558511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:29.987597 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:29.987564    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:29:30.123335 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.123297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls\") pod \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") "
Jul 15 17:29:30.123537 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.123359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc56170c-ac77-4553-b92e-f0450a9f9b1a-openshift-service-ca\") pod \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") "
Jul 15 17:29:30.123537 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.123384    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdstk\" (UniqueName: \"kubernetes.io/projected/bc56170c-ac77-4553-b92e-f0450a9f9b1a-kube-api-access-cdstk\") pod \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\" (UID: \"bc56170c-ac77-4553-b92e-f0450a9f9b1a\") "
Jul 15 17:29:30.123760 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.123734    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc56170c-ac77-4553-b92e-f0450a9f9b1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc56170c-ac77-4553-b92e-f0450a9f9b1a" (UID: "bc56170c-ac77-4553-b92e-f0450a9f9b1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 17:29:30.125657 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.125626    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc56170c-ac77-4553-b92e-f0450a9f9b1a" (UID: "bc56170c-ac77-4553-b92e-f0450a9f9b1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 17:29:30.125657 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.125645    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc56170c-ac77-4553-b92e-f0450a9f9b1a-kube-api-access-cdstk" (OuterVolumeSpecName: "kube-api-access-cdstk") pod "bc56170c-ac77-4553-b92e-f0450a9f9b1a" (UID: "bc56170c-ac77-4553-b92e-f0450a9f9b1a"). InnerVolumeSpecName "kube-api-access-cdstk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 17:29:30.224563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.224520    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc56170c-ac77-4553-b92e-f0450a9f9b1a-maas-api-tls\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:29:30.224563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.224555    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc56170c-ac77-4553-b92e-f0450a9f9b1a-openshift-service-ca\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:29:30.224563 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.224568    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdstk\" (UniqueName: \"kubernetes.io/projected/bc56170c-ac77-4553-b92e-f0450a9f9b1a-kube-api-access-cdstk\") on node \"ip-10-0-135-165.ec2.internal\" DevicePath \"\""
Jul 15 17:29:30.416407 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.416305    2575 generic.go:356] "Generic (PLEG): container finished" podID="bc56170c-ac77-4553-b92e-f0450a9f9b1a" containerID="6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9" exitCode=0
Jul 15 17:29:30.416407 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.416350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" event={"ID":"bc56170c-ac77-4553-b92e-f0450a9f9b1a","Type":"ContainerDied","Data":"6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9"}
Jul 15 17:29:30.416407 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.416402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr" event={"ID":"bc56170c-ac77-4553-b92e-f0450a9f9b1a","Type":"ContainerDied","Data":"09f6b7ce43765195d7a3b3ac4117c89469ee92530509c59c14e547c9547cd743"}
Jul 15 17:29:30.416694 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.416356    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"
Jul 15 17:29:30.416694 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.416434    2575 scope.go:117] "RemoveContainer" containerID="6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9"
Jul 15 17:29:30.426247 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.426227    2575 scope.go:117] "RemoveContainer" containerID="6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9"
Jul 15 17:29:30.426536 ip-10-0-135-165 kubenswrapper[2575]: E0715 17:29:30.426520    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9\": container with ID starting with 6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9 not found: ID does not exist" containerID="6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9"
Jul 15 17:29:30.426594 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.426545    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9"} err="failed to get container status \"6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9\": rpc error: code = NotFound desc = could not find container \"6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9\": container with ID starting with 6d4a2eb7f31247d31d6b9491edbeb5f885e272b3329e4d3942e9bfe934a2feb9 not found: ID does not exist"
Jul 15 17:29:30.436877 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.436847    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"]
Jul 15 17:29:30.440252 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:30.440229    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1e0e66-6bcf848b7f-kpgdr"]
Jul 15 17:29:32.024163 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:32.024129    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc56170c-ac77-4553-b92e-f0450a9f9b1a" path="/var/lib/kubelet/pods/bc56170c-ac77-4553-b92e-f0450a9f9b1a/volumes"
Jul 15 17:29:34.138981 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:34.138946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:40.087943 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:40.087831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:40.190049 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:40.190012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:44.793189 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:44.793154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:45.031604 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:45.031567    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:29:45.452550 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:45.452509    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7779ffdcc4-h2fzm_b016c74a-90be-439a-b576-87e5d1951ec8/authorino/0.log"
Jul 15 17:29:51.623723 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:51.623692    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-tbn9r_53f8061b-2c84-4583-a41a-5495d8bde155/copy-manifests/0.log"
Jul 15 17:29:51.630662 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:51.630640    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-tbn9r_53f8061b-2c84-4583-a41a-5495d8bde155/manager/0.log"
Jul 15 17:29:52.225517 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:52.225489    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735595-l2m5r_fc5c8031-1292-4a05-ac14-6d54e76e7a13/cleanup/0.log"
Jul 15 17:29:52.445296 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:52.445261    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-7bb30196-s78rp_a246884f-7218-4c8c-9f6f-dbc7a26814a3/revoke-keys/0.log"
Jul 15 17:29:53.094679 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:53.094645    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-000d7ff6-4mzff_69b45259-c4f1-483f-976e-6ebd54ba160b/revoke-keys/0.log"
Jul 15 17:29:53.658969 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:53.658934    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-k67hn_7eb17695-ef1f-48ed-aedc-be516915bfb6/postgres/0.log"
Jul 15 17:29:54.938007 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:54.937976    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7779ffdcc4-h2fzm_b016c74a-90be-439a-b576-87e5d1951ec8/authorino/0.log"
Jul 15 17:29:55.289208 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:55.289125    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gknck_c1ad4fe7-9406-4015-964c-e3f23685b74a/kuadrant-console-plugin/0.log"
Jul 15 17:29:56.372466 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:56.372431    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-5pkcd_e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf/kube-auth-proxy/0.log"
Jul 15 17:29:56.835252 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:56.835215    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6jjcs_c95ce879-f3d7-4075-b981-25fbf98bb83c/payload-processing/0.log"
Jul 15 17:29:56.947504 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:56.947479    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7496cb7dcd-n7klc_4b2e7712-5c21-4423-95ab-fd4fc27eb129/router/0.log"
Jul 15 17:29:57.296237 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:57.296156    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gqvx8_cf200aba-ad01-4cf4-8322-00232d9e4bed/main/0.log"
Jul 15 17:29:57.514645 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:29:57.514613    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rc9tn_f6556ebb-eb7d-4404-88df-2a5ee42ed289/main/0.log"
Jul 15 17:30:00.132270 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132229    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"]
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132587    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38908c8-ff69-46d5-b569-0979f2a4fc20" containerName="test-curl-7542-139836660667424"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132598    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38908c8-ff69-46d5-b569-0979f2a4fc20" containerName="test-curl-7542-139836660667424"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132606    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc56170c-ac77-4553-b92e-f0450a9f9b1a" containerName="maas-api"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132611    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc56170c-ac77-4553-b92e-f0450a9f9b1a" containerName="maas-api"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132620    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf79682-0317-4aac-951a-450375e2dfbd" containerName="maas-api"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132625    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf79682-0317-4aac-951a-450375e2dfbd" containerName="maas-api"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132640    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" containerName="main"
Jul 15 17:30:00.132653 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132645    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" containerName="main"
Jul 15 17:30:00.132936 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132718    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf79682-0317-4aac-951a-450375e2dfbd" containerName="maas-api"
Jul 15 17:30:00.132936 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132727    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a38908c8-ff69-46d5-b569-0979f2a4fc20" containerName="test-curl-7542-139836660667424"
Jul 15 17:30:00.132936 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132734    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc56170c-ac77-4553-b92e-f0450a9f9b1a" containerName="maas-api"
Jul 15 17:30:00.132936 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.132741    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc8ae56f-2ea0-45a3-bf2b-7d4019432aa6" containerName="main"
Jul 15 17:30:00.135844 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.135826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"
Jul 15 17:30:00.138247 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.138219    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nthsz\""
Jul 15 17:30:00.142205 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.142178    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"]
Jul 15 17:30:00.147226 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.147208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"
Jul 15 17:30:00.281593 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.281566    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"]
Jul 15 17:30:00.284548 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:30:00.284515    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e40f08_1564_452e_8a64_47f6e1babafd.slice/crio-1a9f1cf61019edec67870161a46c23948b6197765d77136c0ab3a8788473a977 WatchSource:0}: Error finding container 1a9f1cf61019edec67870161a46c23948b6197765d77136c0ab3a8788473a977: Status 404 returned error can't find the container with id 1a9f1cf61019edec67870161a46c23948b6197765d77136c0ab3a8788473a977
Jul 15 17:30:00.560391 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.560365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt" event={"ID":"f1e40f08-1564-452e-8a64-47f6e1babafd","Type":"ContainerStarted","Data":"046f12787f0348a126650740cf595418e61ac886f21b7b0408640c649bb149ef"}
Jul 15 17:30:00.560498 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.560410    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt" event={"ID":"f1e40f08-1564-452e-8a64-47f6e1babafd","Type":"ContainerStarted","Data":"1a9f1cf61019edec67870161a46c23948b6197765d77136c0ab3a8788473a977"}
Jul 15 17:30:00.574580 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:00.574526    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt" podStartSLOduration=0.57450727 podStartE2EDuration="574.50727ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:30:00.573774634 +0000 UTC m=+2987.143649931" watchObservedRunningTime="2026-07-15 17:30:00.57450727 +0000 UTC m=+2987.144382566"
Jul 15 17:30:01.566419 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:01.566316    2575 generic.go:356] "Generic (PLEG): container finished" podID="f1e40f08-1564-452e-8a64-47f6e1babafd" containerID="046f12787f0348a126650740cf595418e61ac886f21b7b0408640c649bb149ef" exitCode=0
Jul 15 17:30:01.566419 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:01.566402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt" event={"ID":"f1e40f08-1564-452e-8a64-47f6e1babafd","Type":"ContainerDied","Data":"046f12787f0348a126650740cf595418e61ac886f21b7b0408640c649bb149ef"}
Jul 15 17:30:02.704646 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:02.704616    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"
Jul 15 17:30:03.576830 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.576771    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt"
Jul 15 17:30:03.576830 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.576816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735610-gm4mt" event={"ID":"f1e40f08-1564-452e-8a64-47f6e1babafd","Type":"ContainerDied","Data":"1a9f1cf61019edec67870161a46c23948b6197765d77136c0ab3a8788473a977"}
Jul 15 17:30:03.577083 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.576871    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a9f1cf61019edec67870161a46c23948b6197765d77136c0ab3a8788473a977"
Jul 15 17:30:03.823981 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.823936    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfgvt/must-gather-9g5lk"]
Jul 15 17:30:03.824493 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.824472    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e40f08-1564-452e-8a64-47f6e1babafd" containerName="cleanup"
Jul 15 17:30:03.824561 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.824496    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e40f08-1564-452e-8a64-47f6e1babafd" containerName="cleanup"
Jul 15 17:30:03.824626 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.824617    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e40f08-1564-452e-8a64-47f6e1babafd" containerName="cleanup"
Jul 15 17:30:03.827864 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.827776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:03.830618 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.830594    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfgvt\"/\"openshift-service-ca.crt\""
Jul 15 17:30:03.831520 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.831505    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfgvt\"/\"default-dockercfg-zs575\""
Jul 15 17:30:03.831600 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.831506    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfgvt\"/\"kube-root-ca.crt\""
Jul 15 17:30:03.835537 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.835516    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/must-gather-9g5lk"]
Jul 15 17:30:03.837760 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.837725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:30:03.926840 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.926775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/50716cbd-dc9b-4a9d-b79c-343538db6088-must-gather-output\") pod \"must-gather-9g5lk\" (UID: \"50716cbd-dc9b-4a9d-b79c-343538db6088\") " pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:03.927009 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:03.926924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvj2m\" (UniqueName: \"kubernetes.io/projected/50716cbd-dc9b-4a9d-b79c-343538db6088-kube-api-access-hvj2m\") pod \"must-gather-9g5lk\" (UID: \"50716cbd-dc9b-4a9d-b79c-343538db6088\") " pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:04.027833 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.027775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/50716cbd-dc9b-4a9d-b79c-343538db6088-must-gather-output\") pod \"must-gather-9g5lk\" (UID: \"50716cbd-dc9b-4a9d-b79c-343538db6088\") " pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:04.028014 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.027882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvj2m\" (UniqueName: \"kubernetes.io/projected/50716cbd-dc9b-4a9d-b79c-343538db6088-kube-api-access-hvj2m\") pod \"must-gather-9g5lk\" (UID: \"50716cbd-dc9b-4a9d-b79c-343538db6088\") " pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:04.028112 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.028090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/50716cbd-dc9b-4a9d-b79c-343538db6088-must-gather-output\") pod \"must-gather-9g5lk\" (UID: \"50716cbd-dc9b-4a9d-b79c-343538db6088\") " pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:04.035922 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.035896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvj2m\" (UniqueName: \"kubernetes.io/projected/50716cbd-dc9b-4a9d-b79c-343538db6088-kube-api-access-hvj2m\") pod \"must-gather-9g5lk\" (UID: \"50716cbd-dc9b-4a9d-b79c-343538db6088\") " pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:04.123991 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.123901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log" limit=1024
Jul 15 17:30:04.138749 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.138719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/must-gather-9g5lk"
Jul 15 17:30:04.272891 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.272866    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/must-gather-9g5lk"]
Jul 15 17:30:04.274907 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:30:04.274880    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50716cbd_dc9b_4a9d_b79c_343538db6088.slice/crio-a512087dfa47df156baf0dfabb918d83f84ca41101e8a9f6ae8de593d0d2b915 WatchSource:0}: Error finding container a512087dfa47df156baf0dfabb918d83f84ca41101e8a9f6ae8de593d0d2b915: Status 404 returned error can't find the container with id a512087dfa47df156baf0dfabb918d83f84ca41101e8a9f6ae8de593d0d2b915
Jul 15 17:30:04.582408 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:04.582372    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/must-gather-9g5lk" event={"ID":"50716cbd-dc9b-4a9d-b79c-343538db6088","Type":"ContainerStarted","Data":"a512087dfa47df156baf0dfabb918d83f84ca41101e8a9f6ae8de593d0d2b915"}
Jul 15 17:30:05.592111 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:05.592028    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/must-gather-9g5lk" event={"ID":"50716cbd-dc9b-4a9d-b79c-343538db6088","Type":"ContainerStarted","Data":"285e7c31e08ae285f12f84f02c1c95a95e6a5554f1a7247c34a14c5d77d4a48a"}
Jul 15 17:30:05.592111 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:05.592082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/must-gather-9g5lk" event={"ID":"50716cbd-dc9b-4a9d-b79c-343538db6088","Type":"ContainerStarted","Data":"3fde5c458e3e440a17be63f278da49eb198078c3005ad3a8ca45dcf93a468b23"}
Jul 15 17:30:05.613074 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:05.612995    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfgvt/must-gather-9g5lk" podStartSLOduration=1.66181403 podStartE2EDuration="2.612973783s" totalImagesPullingTime="951.159753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:30:05.610456468 +0000 UTC m=+2992.180331767" watchObservedRunningTime="2026-07-15 17:30:05.612973783 +0000 UTC m=+2992.182849081"
Jul 15 17:30:06.760477 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:06.760443    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g4xjf_0b995a7c-f16e-4733-ac64-d05c9c089497/global-pull-secret-syncer/0.log"
Jul 15 17:30:06.847294 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:06.847252    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-29mdj_d55ef920-0100-4205-abc1-0b3041279bc1/konnectivity-agent/0.log"
Jul 15 17:30:06.971562 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:06.971530    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-165.ec2.internal_866426ac2f7ae52b0b5d62a269c4afca/haproxy/0.log"
Jul 15 17:30:12.226299 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:12.226261    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7779ffdcc4-h2fzm_b016c74a-90be-439a-b576-87e5d1951ec8/authorino/0.log"
Jul 15 17:30:12.314058 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:12.314017    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gknck_c1ad4fe7-9406-4015-964c-e3f23685b74a/kuadrant-console-plugin/0.log"
Jul 15 17:30:14.162952 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.162143    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:30:14.168734 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.168273    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:30:14.314715 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.314680    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-td7vf_1478d04f-b6e7-4870-ac4a-7341205f1dc8/cluster-monitoring-operator/0.log"
Jul 15 17:30:14.432479 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.432438    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f76779f4d-w2z7c_3f3b8000-a714-49ee-916a-3de0ff6e8257/metrics-server/0.log"
Jul 15 17:30:14.502265 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.502219    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxk5d_19c0e785-b475-4074-943c-8a4a8f4b41ff/node-exporter/0.log"
Jul 15 17:30:14.523421 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.523345    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxk5d_19c0e785-b475-4074-943c-8a4a8f4b41ff/kube-rbac-proxy/0.log"
Jul 15 17:30:14.546293 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.546266    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dxk5d_19c0e785-b475-4074-943c-8a4a8f4b41ff/init-textfile/0.log"
Jul 15 17:30:14.844877 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.844822    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/prometheus/0.log"
Jul 15 17:30:14.868457 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.868428    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/config-reloader/0.log"
Jul 15 17:30:14.891171 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.891127    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/thanos-sidecar/0.log"
Jul 15 17:30:14.911638 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.911585    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/kube-rbac-proxy-web/0.log"
Jul 15 17:30:14.944898 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.944767    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/kube-rbac-proxy/0.log"
Jul 15 17:30:14.964578 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.964534    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/kube-rbac-proxy-thanos/0.log"
Jul 15 17:30:14.987368 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:14.987341    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6388fb3e-536b-45f8-b176-85f30ccea8d4/init-config-reloader/0.log"
Jul 15 17:30:15.186333 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:15.186273    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/thanos-query/0.log"
Jul 15 17:30:15.206128 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:15.206029    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy-web/0.log"
Jul 15 17:30:15.226047 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:15.225999    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy/0.log"
Jul 15 17:30:15.244768 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:15.244735    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/prom-label-proxy/0.log"
Jul 15 17:30:15.265009 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:15.264982    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy-rules/0.log"
Jul 15 17:30:15.284830 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:15.284804    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d5f65f5b-nv2z8_775ac289-ef16-44fa-8bab-e9402502c70b/kube-rbac-proxy-metrics/0.log"
Jul 15 17:30:17.412318 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.412268    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"]
Jul 15 17:30:17.420739 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.420706    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.427083 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.427046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"]
Jul 15 17:30:17.481469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.481094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-lib-modules\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.481469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.481200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-proc\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.481469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.481294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-sys\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.481469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.481345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-podres\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.481469 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.481371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcbv2\" (UniqueName: \"kubernetes.io/projected/bdc4af17-9dfb-4021-8186-7aa56163a89d-kube-api-access-lcbv2\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.583192 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.583147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-sys\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.583890 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.583858    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-sys\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584043 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.583917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-podres\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584043 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.583948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbv2\" (UniqueName: \"kubernetes.io/projected/bdc4af17-9dfb-4021-8186-7aa56163a89d-kube-api-access-lcbv2\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584043 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.584001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-lib-modules\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584173 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.584092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-proc\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584220 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.584162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-lib-modules\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584220 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.584183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-proc\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.584220 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.584061    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdc4af17-9dfb-4021-8186-7aa56163a89d-podres\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.592694 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.592662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbv2\" (UniqueName: \"kubernetes.io/projected/bdc4af17-9dfb-4021-8186-7aa56163a89d-kube-api-access-lcbv2\") pod \"perf-node-gather-daemonset-pmqg6\" (UID: \"bdc4af17-9dfb-4021-8186-7aa56163a89d\") " pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.735158 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.735059    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:17.843092 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.843055    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-8z7qk_981edb29-0c6a-4e3c-a2c0-f1c3dd60a986/download-server/0.log"
Jul 15 17:30:17.930817 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:17.925129    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"]
Jul 15 17:30:17.947591 ip-10-0-135-165 kubenswrapper[2575]: W0715 17:30:17.946877    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdc4af17_9dfb_4021_8186_7aa56163a89d.slice/crio-855ccf84bcaafc393a1d7fcbc729f65235fb827e8758d7bbdfc6eab8d2e33c89 WatchSource:0}: Error finding container 855ccf84bcaafc393a1d7fcbc729f65235fb827e8758d7bbdfc6eab8d2e33c89: Status 404 returned error can't find the container with id 855ccf84bcaafc393a1d7fcbc729f65235fb827e8758d7bbdfc6eab8d2e33c89
Jul 15 17:30:18.710097 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:18.710046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6" event={"ID":"bdc4af17-9dfb-4021-8186-7aa56163a89d","Type":"ContainerStarted","Data":"991e57654516a380464f90ae31baa31435dccbc1847c4b3e620f96e414ed76ab"}
Jul 15 17:30:18.710522 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:18.710130    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6" event={"ID":"bdc4af17-9dfb-4021-8186-7aa56163a89d","Type":"ContainerStarted","Data":"855ccf84bcaafc393a1d7fcbc729f65235fb827e8758d7bbdfc6eab8d2e33c89"}
Jul 15 17:30:18.710522 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:18.710162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:18.726866 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:18.726801    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6" podStartSLOduration=1.7267652230000001 podStartE2EDuration="1.726765223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:30:18.725936024 +0000 UTC m=+3005.295811321" watchObservedRunningTime="2026-07-15 17:30:18.726765223 +0000 UTC m=+3005.296640529"
Jul 15 17:30:19.488998 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:19.488966    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cszs7_894d176c-ac2c-4562-82df-3c58378aa6eb/dns/0.log"
Jul 15 17:30:19.509935 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:19.509904    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cszs7_894d176c-ac2c-4562-82df-3c58378aa6eb/kube-rbac-proxy/0.log"
Jul 15 17:30:19.613074 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:19.613045    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smvl6_ecb014ab-7df6-43ff-b6df-5164e09bde95/dns-node-resolver/0.log"
Jul 15 17:30:20.129113 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:20.129058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56879b6cb7-gzz7m_04fbdd42-e9a9-4a79-b166-b12da2fdd241/registry/1.log"
Jul 15 17:30:20.143370 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:20.143339    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56879b6cb7-gzz7m_04fbdd42-e9a9-4a79-b166-b12da2fdd241/registry/2.log"
Jul 15 17:30:20.189026 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:20.188989    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlk9h_9b36c47c-a728-453c-94f3-c2e732977410/node-ca/0.log"
Jul 15 17:30:21.237649 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:21.237615    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-5pkcd_e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf/kube-auth-proxy/0.log"
Jul 15 17:30:21.375497 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:21.375468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6jjcs_c95ce879-f3d7-4075-b981-25fbf98bb83c/payload-processing/0.log"
Jul 15 17:30:21.395661 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:21.395625    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7496cb7dcd-n7klc_4b2e7712-5c21-4423-95ab-fd4fc27eb129/router/0.log"
Jul 15 17:30:22.052065 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:22.052021    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xvnw_c00c3351-8a70-459d-a6ea-e7ff30898a78/serve-healthcheck-canary/0.log"
Jul 15 17:30:22.701533 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:22.701497    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6tm_c3bb2c3c-ee45-482a-b3e9-4766df52e299/kube-rbac-proxy/0.log"
Jul 15 17:30:22.723555 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:22.723526    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6tm_c3bb2c3c-ee45-482a-b3e9-4766df52e299/exporter/0.log"
Jul 15 17:30:22.745052 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:22.745021    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qb6tm_c3bb2c3c-ee45-482a-b3e9-4766df52e299/extractor/0.log"
Jul 15 17:30:24.731199 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:24.731169    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfgvt/perf-node-gather-daemonset-pmqg6"
Jul 15 17:30:25.372837 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:25.372775    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-tbn9r_53f8061b-2c84-4583-a41a-5495d8bde155/manager/0.log"
Jul 15 17:30:25.391281 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:25.391255    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9487b7458-tbn9r_53f8061b-2c84-4583-a41a-5495d8bde155/copy-manifests/0.log"
Jul 15 17:30:26.724493 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:26.724455    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c79d97d55-4vv7p_6bc9e6c9-33b8-4691-aaea-2e4f6f929278/manager/0.log"
Jul 15 17:30:28.362993 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:28.362965    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-5pkcd_e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf/kube-auth-proxy/0.log"
Jul 15 17:30:28.474309 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:28.474269    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6jjcs_c95ce879-f3d7-4075-b981-25fbf98bb83c/payload-processing/0.log"
Jul 15 17:30:28.489936 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:28.489906    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7496cb7dcd-n7klc_4b2e7712-5c21-4423-95ab-fd4fc27eb129/router/0.log"
Jul 15 17:30:29.944156 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:29.944118    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fbd7ccb4-5pkcd_e7a6bfaf-9bd0-4bb3-b7b7-32dd9f135cdf/kube-auth-proxy/0.log"
Jul 15 17:30:30.059722 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:30.059685    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6jjcs_c95ce879-f3d7-4075-b981-25fbf98bb83c/payload-processing/0.log"
Jul 15 17:30:30.075162 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:30.075128    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7496cb7dcd-n7klc_4b2e7712-5c21-4423-95ab-fd4fc27eb129/router/0.log"
Jul 15 17:30:32.356098 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:32.356071    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-nr4z9_4c3e7bf8-1b18-474c-a724-977437d34227/kube-storage-version-migrator-operator/1.log"
Jul 15 17:30:32.356956 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:32.356933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-nr4z9_4c3e7bf8-1b18-474c-a724-977437d34227/kube-storage-version-migrator-operator/0.log"
Jul 15 17:30:33.316435 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.316338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/kube-multus-additional-cni-plugins/0.log"
Jul 15 17:30:33.336595 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.336555    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/egress-router-binary-copy/0.log"
Jul 15 17:30:33.359925 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.359894    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/cni-plugins/0.log"
Jul 15 17:30:33.380879 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.380848    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/bond-cni-plugin/0.log"
Jul 15 17:30:33.402685 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.402655    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/routeoverride-cni/0.log"
Jul 15 17:30:33.421121 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.421092    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/whereabouts-cni-bincopy/0.log"
Jul 15 17:30:33.439882 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.439853    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkd6k_af4944f4-8a9f-469d-968f-efb49eeeac8b/whereabouts-cni/0.log"
Jul 15 17:30:33.780918 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.780888    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hlktn_74f99036-13b3-4aab-ab8b-c3d41f55250d/kube-multus/0.log"
Jul 15 17:30:33.916026 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.915999    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dg7fn_0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38/network-metrics-daemon/0.log"
Jul 15 17:30:33.934734 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:33.934702    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dg7fn_0d646b72-a7fa-47fc-ba1c-f3cb08d7bd38/kube-rbac-proxy/0.log"
Jul 15 17:30:35.112917 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.112882    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-controller/0.log"
Jul 15 17:30:35.128867 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.128838    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/0.log"
Jul 15 17:30:35.128867 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.128853    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovn-acl-logging/1.log"
Jul 15 17:30:35.149070 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.149041    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/kube-rbac-proxy-node/0.log"
Jul 15 17:30:35.169575 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.169535    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 15 17:30:35.185312 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.185277    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/northd/0.log"
Jul 15 17:30:35.203848 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.203822    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/nbdb/0.log"
Jul 15 17:30:35.222938 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.222877    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/sbdb/0.log"
Jul 15 17:30:35.293767 ip-10-0-135-165 kubenswrapper[2575]: I0715 17:30:35.293736    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vpvmq_b888e67a-0695-497b-827f-59fb831bdad3/ovnkube-controller/0.log"