Jul 31 21:34:30.481180 ip-10-0-142-220 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 21:34:30.481190 ip-10-0-142-220 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 21:34:30.481197 ip-10-0-142-220 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 21:34:30.481527 ip-10-0-142-220 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 21:34:40.730516 ip-10-0-142-220 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 21:34:40.730530 ip-10-0-142-220 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3b61c9908aa945e6a52b8a0ddf6d4d9f --
Jul 31 21:36:13.791274 ip-10-0-142-220 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 21:36:14.237127 ip-10-0-142-220 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:36:14.237127 ip-10-0-142-220 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 21:36:14.237127 ip-10-0-142-220 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:36:14.237127 ip-10-0-142-220 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 21:36:14.237127 ip-10-0-142-220 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:36:14.239174 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.239089    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 21:36:14.244625 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244605    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244626    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244631    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244634    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244637    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244640    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244643    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244646    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244649    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244652    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244655    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244665    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244668    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244671    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:14.244668 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244673    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244676    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244679    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244682    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244684    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244686    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244689    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244692    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244694    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244696    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244699    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244701    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244704    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244707    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244709    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244711    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244714    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244716    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244719    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244722    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:14.245100 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244724    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244726    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244729    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244731    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244734    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244736    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244738    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244741    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244743    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244746    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244749    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244751    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244754    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244756    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244761    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244765    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244768    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244771    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244773    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:14.245863 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244776    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244778    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244781    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244783    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244786    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244788    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244791    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244793    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244796    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244798    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244801    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244804    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244806    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244809    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244811    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244813    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244816    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244818    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244820    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:14.246474 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244824    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244826    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244828    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244831    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.244875    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245147    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245160    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245167    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245175    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245183    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245189    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245194    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245199    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245204    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245209    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245214    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245223    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245227    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245232    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:14.246940 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245236    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245240    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245245    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245250    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245254    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245259    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245263    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.245267    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246786    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246796    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246800    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246803    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246807    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246810    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246813    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246816    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246819    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246822    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246826    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246828    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:14.247411 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246831    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246833    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246836    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246838    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246841    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246843    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246847    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246849    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246852    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246854    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246857    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246859    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246861    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246866    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246869    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246872    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246874    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246877    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246880    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:14.247904 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246882    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246885    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246888    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246891    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246894    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246896    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246899    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246901    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246904    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246907    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246910    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246912    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246915    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246917    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246919    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246923    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246927    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246929    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246932    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:14.248373 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246935    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246938    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246941    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246943    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246946    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246949    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246952    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246969    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246971    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246974    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246977    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246979    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246982    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246985    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246988    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246990    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246993    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246997    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.246999    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247001    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:14.248832 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247004    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247007    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247009    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247012    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247014    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247016    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247019    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247021    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247024    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247026    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247028    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247033    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247036    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247039    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247043    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247046    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247049    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247051    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247054    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:14.249319 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247057    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247060    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247062    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247065    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247068    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247071    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247073    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247076    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247078    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247081    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247444    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247449    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247452    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247454    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247457    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247459    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247462    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247465    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247469    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247472    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:14.249783 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247475    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247477    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247480    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247483    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247487    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247489    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247492    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247495    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247497    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247500    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247503    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247506    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247508    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247510    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247513    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247515    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247518    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247521    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247523    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:14.250300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247526    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247529    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247531    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247533    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247536    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247538    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247541    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247543    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247546    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247548    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247550    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247553    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247555    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247558    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247562    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247566    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247568    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247572    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247575    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:14.250748 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247577    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247580    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247582    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247585    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247588    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247591    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247593    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247596    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247599    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247603    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247605    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247608    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247611    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247613    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247616    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247618    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247620    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247623    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247626    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247629    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:14.251321 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247631    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247634    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247636    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247638    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247641    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247643    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247645    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247648    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247650    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247653    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247656    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247659    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247661    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247664    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247667    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247669    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247672    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247674    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247677    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247679    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:14.251821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247682    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247684    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247687    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247689    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247692    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247694    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247697    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247700    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247702    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247704    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.247707    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247772    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247779    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247784    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247789    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247802    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247805    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247809    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247813    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247816    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247819    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 21:36:14.252300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247823    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247828    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247832    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247835    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247837    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247841    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247843    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247846    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247851    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247854    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247857    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247860    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247863    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247867    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247870    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247873    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247877    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247880    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247883    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247886    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247889    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247892    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247896    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247899    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247901    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 21:36:14.252829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247904    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247907    2557 flags.go:64] FLAG: --enable-server="true"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247910    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247914    2557 flags.go:64] FLAG: --event-burst="100"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247917    2557 flags.go:64] FLAG: --event-qps="50"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247920    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247923    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247926    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247931    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247933    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247936    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247939    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247942    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247945    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247947    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247950    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247953    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247967    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247970    2557 flags.go:64] FLAG: --feature-gates=""
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247977    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247980    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247983    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247986    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247989    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247992    2557 flags.go:64] FLAG: --help="false"
Jul 31 21:36:14.253431 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247996    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.247999    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248002    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248005    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248008    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248011    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248014    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248016    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248019    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248022    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248024    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248027    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248031    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248033    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248036    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248039    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248042    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248045    2557 flags.go:64] FLAG: --lock-file=""
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248048    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248051    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248054    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248059    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248062    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248065    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 21:36:14.254072 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248067    2557 flags.go:64] FLAG: --logging-format="text"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248070    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248073    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248076    2557 flags.go:64] FLAG: --manifest-url=""
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248078    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248083    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248086    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248090    2557 flags.go:64] FLAG: --max-pods="110"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248096    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248099    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248102    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248104    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248107    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248110    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248113    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248120    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248123    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248126    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248129    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248132    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248138    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248141    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248144    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248147    2557 flags.go:64] FLAG: --port="10250"
Jul 31 21:36:14.255039 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248150    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248153    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a2be56e8dbb5bf75"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248156    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248159    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248161    2557 flags.go:64] FLAG: --register-node="true"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248164    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248168    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248170    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248173    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248175    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248179    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248182    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248185    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248187    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248190    2557 flags.go:64] FLAG: --runonce="false"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248193    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248196    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248199    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248202    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248204    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248207    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248210    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248213    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248216    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248218    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 21:36:14.256037 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248221    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248224    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248227    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248230    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248233    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248238    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248241    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248244    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248248    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248251    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248254    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248257    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248260    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248262    2557 flags.go:64] FLAG: --v="2"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248266    2557 flags.go:64] FLAG: --version="false"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248270    2557 flags.go:64] FLAG: --vmodule=""
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248273    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248276    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248388    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248391    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248394    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248397    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248399    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:14.256786 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248404    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248406    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248409    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248412    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248416    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248420    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248423    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248426    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248428    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248431    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248435    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248438    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248441    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248444    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248446    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248451    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248454    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248456    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248459    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:14.257476 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248462    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248465    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248468    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248471    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248474    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248477    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248479    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248482    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248485    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248488    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248490    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248493    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248495    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248500    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248502    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248504    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248507    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248510    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248513    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:14.258320 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248515    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248518    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248520    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248523    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248525    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248528    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248531    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248533    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248536    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248539    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248542    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248544    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248547    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248551    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248554    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248557    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248560    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248562    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248564    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248567    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:14.258973 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248570    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248572    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248575    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248578    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248580    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248583    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248587    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248589    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248592    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248594    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248599    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248601    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248604    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248606    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248609    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248611    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248614    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248616    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248618    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248628    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:14.259513 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248631    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248635    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248638    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248641    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248643    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248646    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248648    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248651    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248653    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248656    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248658    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248661    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248663    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248666    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248668    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:14.260329 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.248671    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.248676    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.256326    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.256345    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.257249    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.257264    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257350    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257358    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257364    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257369    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257373    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257377    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257381    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257386    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257390    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:14.260721 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257394    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257398    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257403    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257407    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257411    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257416    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257420    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257425    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257429    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257433    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257437    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257441    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257445    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257450    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257455    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257459    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257463    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257467    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257471    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257475    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:14.261111 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257481    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257485    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257489    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257493    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257497    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257501    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257506    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257510    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257515    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257520    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257524    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257529    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257533    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257537    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257541    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257545    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257549    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257555    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257561    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257565    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:14.261821 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257570    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257574    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257578    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257582    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257586    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257590    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257596    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257602    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257607    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257611    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257616    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257622    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257627    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257633    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257638    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257643    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257647    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257652    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257656    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:14.262339 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257660    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257665    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257669    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257673    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257677    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257681    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257685    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257689    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257693    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257697    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257701    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257705    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257710    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257714    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257717    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257721    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257726    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257730    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257734    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257738    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:14.262915 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257742    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257748    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257754    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257758    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257763    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257767    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257772    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257776    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257780    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257784    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257788    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.257796    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.257991    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258001    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258005    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:36:14.263522 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258010    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258014    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258047    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258053    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258058    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258063    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258067    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258072    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258077    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258081    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258085    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258090    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258094    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258099    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258103    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258108    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258112    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258116    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258120    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258125    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:36:14.263932 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258129    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258133    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258137    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258141    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258145    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258150    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258155    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258159    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258163    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258167    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258171    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258175    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258179    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258183    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258187    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258191    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258195    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258199    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258203    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258207    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:36:14.264421 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258211    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258215    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258220    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258226    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258232    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258237    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258241    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258245    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258249    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258253    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258257    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258262    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258266    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258270    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258274    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258278    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258282    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258286    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258291    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258296    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:36:14.264934 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258300    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258306    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258312    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258317    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258321    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258325    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258330    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258334    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258338    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258342    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258347    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258351    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258355    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258360    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258364    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258369    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258373    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258377    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258381    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:36:14.265488 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258385    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258389    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258393    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258398    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258404    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258409    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258414    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258418    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258423    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258428    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258432    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258436    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258442    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258446    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258451    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258455    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:36:14.265933 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:14.258459    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:36:14.266390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.258466    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:36:14.266390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.258624    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 21:36:14.266390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.262649    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 21:36:14.266390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.265382    2557 server.go:1019] "Starting client certificate rotation"
Jul 31 21:36:14.266390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.265482    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 21:36:14.266390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.265522    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 21:36:14.268182 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.268165    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 21:36:14.269356 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.269336    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 21:36:14.278542 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.278523    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 31 21:36:14.280766 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.280752    2557 log.go:25] "Validated CRI v1 image API"
Jul 31 21:36:14.281539 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.281517    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 21:36:14.284091 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.284072    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7cf43c58-6f91-4674-b105-128425b9f84d:/dev/nvme0n1p4 dfb92c2f-a4c0-4efb-be5c-d909685fab22:/dev/nvme0n1p3]
Jul 31 21:36:14.284142 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.284092    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 21:36:14.290077 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.289971    2557 manager.go:216] Machine: {Timestamp:2026-07-31 21:36:14.288563415 +0000 UTC m=+0.371572210 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201926 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8f31644a9eed3d8f4bb00e6f89d3 SystemUUID:ec2a8f31-644a-9eed-3d8f-4bb00e6f89d3 BootID:3b61c990-8aa9-45e6-a52b-8a0ddf6d4d9f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:eb:17:81:9a:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:eb:17:81:9a:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:65:ba:24:4f:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 21:36:14.290077 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.290072    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 21:36:14.290188 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.290153    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 21:36:14.292309 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.292287    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 21:36:14.292451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.292312    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 21:36:14.293999 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.293988    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 21:36:14.294038 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.294006    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 21:36:14.294038 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.294023    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 21:36:14.294720 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.294709    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 21:36:14.295984 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.295973    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 21:36:14.296386 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.296371    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 21:36:14.300046 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300035    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 21:36:14.300173 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300163    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 21:36:14.300201 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300191    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 21:36:14.300201 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300200    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 21:36:14.300253 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300213    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 21:36:14.300253 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300222    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 31 21:36:14.300253 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300250    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 21:36:14.300588 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300576    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 21:36:14.300689 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.300597    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 21:36:14.302976 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.302949    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 21:36:14.305369 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.305356    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 21:36:14.305407 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.305385    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 21:36:14.307490 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307479    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 21:36:14.307525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307495    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 21:36:14.307525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307501    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 21:36:14.307525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307507    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 21:36:14.307525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307515    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 21:36:14.307525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307522    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 21:36:14.307668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307529    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 21:36:14.307668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307534    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 21:36:14.307668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307540    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 21:36:14.307668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307545    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 21:36:14.307668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307563    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 21:36:14.307668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.307568    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 21:36:14.308322 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.308312    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 21:36:14.308322 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.308322    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 21:36:14.311659 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.311643    2557 server.go:1268] "Started kubelet"
Jul 31 21:36:14.311758 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.311686    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 21:36:14.311758 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.311683    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 21:36:14.311858 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.311771    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 21:36:14.312538 ip-10-0-142-220 systemd[1]: Started Kubernetes Kubelet.
Jul 31 21:36:14.313293 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.313249    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 21:36:14.313464 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.313336    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 21:36:14.313464 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.313382    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 21:36:14.313764 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.313745    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 21:36:14.316203 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.316187    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 21:36:14.318442 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.318413    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 21:36:14.321174 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.320120    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-220.ec2.internal.18c77d81f04ad2a6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-220.ec2.internal,UID:ip-10-0-142-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-220.ec2.internal,},FirstTimestamp:2026-07-31 21:36:14.311379622 +0000 UTC m=+0.394388416,LastTimestamp:2026-07-31 21:36:14.311379622 +0000 UTC m=+0.394388416,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-220.ec2.internal,}"
Jul 31 21:36:14.321755 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.321734    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 21:36:14.321755 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.321752    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 21:36:14.321892 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.321834    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.322515 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322498    2557 factory.go:55] Registering systemd factory
Jul 31 21:36:14.322603 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322551    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 31 21:36:14.322603 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322502    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 21:36:14.322603 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322506    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 21:36:14.322603 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322603    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 21:36:14.322784 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322688    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 21:36:14.322784 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322698    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 21:36:14.322784 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322766    2557 factory.go:153] Registering CRI-O factory
Jul 31 21:36:14.322784 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322778    2557 factory.go:223] Registration of the crio container factory successfully
Jul 31 21:36:14.322971 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322825    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 21:36:14.322971 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322846    2557 factory.go:103] Registering Raw factory
Jul 31 21:36:14.322971 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.322861    2557 manager.go:1196] Started watching for new ooms in manager
Jul 31 21:36:14.323332 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.323320    2557 manager.go:349] Starting recovery of all containers
Jul 31 21:36:14.326557 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.326536    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gj6ns"
Jul 31 21:36:14.332435 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.332421    2557 manager.go:354] Recovery completed
Jul 31 21:36:14.335284 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.335256    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 21:36:14.335388 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.335283    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 21:36:14.335532 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.335516    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gj6ns"
Jul 31 21:36:14.336480 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.336468    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.338403 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338332    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.338403 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338356    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.338403 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338366    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338919    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338938    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338968    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.338983    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.339717    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.339746    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.339776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.339761    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.340173 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.340159    2557 policy_none.go:49] "None policy: Start"
Jul 31 21:36:14.340229 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.340185    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 21:36:14.340229 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.340201    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 21:36:14.341341 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.341328    2557 policy_none.go:47] "Start"
Jul 31 21:36:14.374788 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.374596    2557 manager.go:337] "Starting Device Plugin manager"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.374798    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.374812    2557 server.go:87] "Starting device plugin registration server"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.375072    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.375084    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.375175    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.375297    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.375306    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.375749    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 21:36:14.389818 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.375795    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.476100 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.476074    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.477795 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.477773    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.477910 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.477806    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.477910 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.477818    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.477910 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.477849    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.478857 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.478834    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 21:36:14.480022 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.480003    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 21:36:14.480115 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.480044    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 21:36:14.480115 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.480068    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 21:36:14.480115 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.480107    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 21:36:14.481608 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.481592    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:14.485239 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.485224    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.485316 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.485248    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-220.ec2.internal\": node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.530382 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.530325    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.581073 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.581042    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"]
Jul 31 21:36:14.581192 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.581128    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.582003 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.581987    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.582090 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.582015    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.582090 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.582025    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.583299 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.583288    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.583428 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.583414    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.583472 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.583445    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.583967 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.583936    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.584065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.583977    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.584065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.583990    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.584065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.584022    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.584065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.584044    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.584065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.584058    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.585086 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.585073    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.585142 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.585095    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:36:14.585708 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.585693    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:36:14.585766 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.585721    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:36:14.585766 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.585732    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:36:14.610511 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.610488    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-220.ec2.internal\" not found" node="ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.614750 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.614734    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-220.ec2.internal\" not found" node="ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.624417 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.624399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70a151c6e1ba236684bfa7e6ef9cf985-config\") pod \"kube-apiserver-proxy-ip-10-0-142-220.ec2.internal\" (UID: \"70a151c6e1ba236684bfa7e6ef9cf985\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.624479 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.624420    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/248d0f7e722cfd0e6b4146e47b156c9b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"248d0f7e722cfd0e6b4146e47b156c9b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.624479 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.624437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/248d0f7e722cfd0e6b4146e47b156c9b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"248d0f7e722cfd0e6b4146e47b156c9b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.630510 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.630497    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.724810 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.724777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/248d0f7e722cfd0e6b4146e47b156c9b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"248d0f7e722cfd0e6b4146e47b156c9b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.724810 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.724808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/248d0f7e722cfd0e6b4146e47b156c9b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"248d0f7e722cfd0e6b4146e47b156c9b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.725062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.724829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70a151c6e1ba236684bfa7e6ef9cf985-config\") pod \"kube-apiserver-proxy-ip-10-0-142-220.ec2.internal\" (UID: \"70a151c6e1ba236684bfa7e6ef9cf985\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.725062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.724892    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/248d0f7e722cfd0e6b4146e47b156c9b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"248d0f7e722cfd0e6b4146e47b156c9b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.725062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.724946    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/248d0f7e722cfd0e6b4146e47b156c9b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"248d0f7e722cfd0e6b4146e47b156c9b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.725062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.725016    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70a151c6e1ba236684bfa7e6ef9cf985-config\") pod \"kube-apiserver-proxy-ip-10-0-142-220.ec2.internal\" (UID: \"70a151c6e1ba236684bfa7e6ef9cf985\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.730874 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.730857    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.831735 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.831665    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:14.912903 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.912871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.917576 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:14.917556    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:14.932267 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:14.932249    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.032817 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.032791    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.133312 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.133259    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.139508 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.139493    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:15.233840 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.233813    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.264996 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.264977    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 21:36:15.265359 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.265093    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 21:36:15.265359 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.265125    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 21:36:15.334216 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.334193    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.341549 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.341519    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 21:31:15 +0000 UTC" deadline="2028-01-30 13:51:05.433572915 +0000 UTC"
Jul 31 21:36:15.341549 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.341543    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13144h14m50.092033918s"
Jul 31 21:36:15.379364 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.379340    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:15.434923 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.434872    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.535503 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.535471    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.572070 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:15.572034    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a151c6e1ba236684bfa7e6ef9cf985.slice/crio-69b13c12c6f91c3bd847191e558ad7c2afb37d92cca8d49fedaa02aab64e1c52 WatchSource:0}: Error finding container 69b13c12c6f91c3bd847191e558ad7c2afb37d92cca8d49fedaa02aab64e1c52: Status 404 returned error can't find the container with id 69b13c12c6f91c3bd847191e558ad7c2afb37d92cca8d49fedaa02aab64e1c52
Jul 31 21:36:15.572590 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:15.572568    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248d0f7e722cfd0e6b4146e47b156c9b.slice/crio-0aa06b9a09f54411d02b784600ff39d00d2143ba09bde67bd98dd2c6ab3fc7a7 WatchSource:0}: Error finding container 0aa06b9a09f54411d02b784600ff39d00d2143ba09bde67bd98dd2c6ab3fc7a7: Status 404 returned error can't find the container with id 0aa06b9a09f54411d02b784600ff39d00d2143ba09bde67bd98dd2c6ab3fc7a7
Jul 31 21:36:15.577557 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.577540    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:36:15.635791 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:15.635768    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found"
Jul 31 21:36:15.667186 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.667163    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:15.724650 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.724592    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:15.739889 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.739873    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 21:36:15.741001 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.740986    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"
Jul 31 21:36:15.751664 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:15.751652    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 21:36:16.302963 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.302934    2557 apiserver.go:52] "Watching apiserver"
Jul 31 21:36:16.311425 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.311402    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 21:36:16.311899 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.311874    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lx5mt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5","openshift-cluster-node-tuning-operator/tuned-zkl2c","openshift-dns/node-resolver-z29n6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal","openshift-network-operator/iptables-alerter-4qpfs","openshift-ovn-kubernetes/ovnkube-node-dgcgb","kube-system/global-pull-secret-syncer-kv9ct","kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal","openshift-image-registry/node-ca-ntbwp","openshift-multus/multus-additional-cni-plugins-5dtwt","openshift-multus/multus-tvp9k","openshift-multus/network-metrics-daemon-qnwl6","openshift-network-diagnostics/network-check-target-5cv2k"]
Jul 31 21:36:16.316102 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.315243    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.320144 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.319689    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 21:36:16.320144 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.319771    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 21:36:16.320144 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.319957    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rz4fr\""
Jul 31 21:36:16.320144 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.320022    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 21:36:16.324727 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.322580    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.324727 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.322796    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.325656    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.325950    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.326555    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-42gq9\""
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.326824    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.327009    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.327301    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 21:36:16.327706 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.327478    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.330425 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.329520    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.330425 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.329580    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 21:36:16.330425 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.330252    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.334239 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.332919    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334381    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334404    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysctl-d\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ntqk\" (UniqueName: \"kubernetes.io/projected/74da28f3-1cfe-41de-94ae-0b7f6f81c033-kube-api-access-6ntqk\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.334444    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-node-log\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-log-socket\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovnkube-config\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovnkube-script-lib\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-modprobe-d\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysconfig\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.334718 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334678    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-run\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334734    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-systemd-units\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334805    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-ovn\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysctl-conf\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334943    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-systemd\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.334993    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-cni-netd\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335018    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-cnibin\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74da28f3-1cfe-41de-94ae-0b7f6f81c033-tmp\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-kubelet\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-slash\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-systemd\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335180    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-sys\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.335391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335203    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-lib-modules\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-var-lib-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovn-node-metrics-cert\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335332    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-os-release\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-tuned\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-env-overrides\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-kubernetes\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-etc-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335506    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-kube-api-access-mdtph\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-system-cni-dir\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7pz\" (UniqueName: \"kubernetes.io/projected/063389fa-2772-4bfc-b51a-1d25255c9a16-kube-api-access-ld7pz\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-var-lib-kubelet\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-host\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-run-netns\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.335729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-cni-bin\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.336973 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.336926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.337235 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.337213    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.337473 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.337456    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.337954 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.337795    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hknz5\""
Jul 31 21:36:16.337954 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.337865    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.338107 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.337997    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.338310 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.338289    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z86rc\""
Jul 31 21:36:16.340548 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.339415    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.340645 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.340622    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:16.341309 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.341292    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.341416 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.341391    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 21:36:16.342015 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.341993    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.343730 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.343708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:16.343847 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.343826    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:16.344209 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.344164    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsppq\""
Jul 31 21:36:16.346557 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.346536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.347617 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.347594    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 21:36:16.348882 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.348865    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.349337 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.349315    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.351423 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.351398    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.352553 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.352530    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 21:36:16.352672 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.352654    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.353860 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.353839    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.353955 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.353909    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 21:36:16.354748 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.354729    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 21:36:16.354960 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.354943    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2lc78\""
Jul 31 21:36:16.355062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.355046    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 21:36:16.355129 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.355107    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 21:36:16.355328 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.355310    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 21:36:16.355395 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.355369    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6dwf\""
Jul 31 21:36:16.355501 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.355315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tmhdb\""
Jul 31 21:36:16.357215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.357193    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 21:36:16.358702 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.358680    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q84cd\""
Jul 31 21:36:16.377018 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.376994    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pjg2p"
Jul 31 21:36:16.389022 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.388921    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pjg2p"
Jul 31 21:36:16.423743 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.423722    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 21:36:16.436289 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-cni-bin\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.436391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovnkube-config\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.436391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovnkube-script-lib\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.436391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-modprobe-d\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.436391 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436378    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysconfig\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-cni-bin\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1895e645-ab01-4301-a95e-e1410723193a-host-slash\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436487    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-ovn\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436513    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-modprobe-d\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysctl-conf\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-serviceca\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.436612 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436607    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-cni-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436633    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-systemd\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436659    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-cni-netd\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74da28f3-1cfe-41de-94ae-0b7f6f81c033-tmp\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-cnibin\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436775    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-slash\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436800    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-systemd\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n62h5\" (UniqueName: \"kubernetes.io/projected/e26873ec-3dc3-4972-9966-c7ab244be462-kube-api-access-n62h5\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436903    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-os-release\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-tuned\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-slash\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvx6b\" (UniqueName: \"kubernetes.io/projected/c9102a20-c095-41e5-9cce-5112fd032423-kube-api-access-hvx6b\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovnkube-script-lib\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437095 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-systemd\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437107    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysconfig\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437126    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovnkube-config\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.436959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-ovn\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437168    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-systemd\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-cni-binary-copy\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-cni-netd\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437204    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-cni-bin\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437217    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysctl-conf\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-host\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437231    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-os-release\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437249    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437295    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83b91889-0841-4386-bef9-29bf74a33547-kubelet-config\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7pz\" (UniqueName: \"kubernetes.io/projected/063389fa-2772-4bfc-b51a-1d25255c9a16-kube-api-access-ld7pz\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-var-lib-kubelet\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.437890 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-host\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-device-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-etc-selinux\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-run-netns\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysctl-d\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ntqk\" (UniqueName: \"kubernetes.io/projected/74da28f3-1cfe-41de-94ae-0b7f6f81c033-kube-api-access-6ntqk\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437562    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-var-lib-kubelet\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxcm9\" (UniqueName: \"kubernetes.io/projected/1895e645-ab01-4301-a95e-e1410723193a-kube-api-access-nxcm9\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437600    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-host\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879rp\" (UniqueName: \"kubernetes.io/projected/309c3407-8711-4dfa-a4d6-7a8b438cf173-kube-api-access-879rp\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8467d52a-9653-4ace-850b-987fde89d0dc-konnectivity-ca\") pod \"konnectivity-agent-lx5mt\" (UID: \"8467d52a-9653-4ace-850b-987fde89d0dc\") " pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-daemon-config\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437679    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-node-log\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437699    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-sysctl-d\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-log-socket\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437702    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-log-socket\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.438682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437777    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-run-netns\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437814    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-node-log\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-cni-binary-copy\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-run\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437878    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1895e645-ab01-4301-a95e-e1410723193a-iptables-alerter-script\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437928    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-registration-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8467d52a-9653-4ace-850b-987fde89d0dc-agent-certs\") pod \"konnectivity-agent-lx5mt\" (UID: \"8467d52a-9653-4ace-850b-987fde89d0dc\") " pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-multus-certs\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.437960    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-run\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-systemd-units\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438104    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-systemd-units\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-k8s-cni-cncf-io\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-netns\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.439550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438184    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-kubelet\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-run-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438209    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-hostroot\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438261    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-etc-kubernetes\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-cnibin\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438347    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-cnibin\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438348    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-system-cni-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438387    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-os-release\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438432    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dw4z\" (UniqueName: \"kubernetes.io/projected/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-kube-api-access-2dw4z\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-kubelet\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-sys\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-lib-modules\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83b91889-0841-4386-bef9-29bf74a33547-dbus\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-socket-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-conf-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.440451 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438600    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-host-kubelet\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-var-lib-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovn-node-metrics-cert\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e26873ec-3dc3-4972-9966-c7ab244be462-hosts-file\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-sys\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438690    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-lib-modules\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438730    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-var-lib-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438695    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-cni-multus\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-env-overrides\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-kubernetes\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438792    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/063389fa-2772-4bfc-b51a-1d25255c9a16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e26873ec-3dc3-4972-9966-c7ab244be462-tmp-dir\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58v22\" (UniqueName: \"kubernetes.io/projected/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-kube-api-access-58v22\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-socket-dir-parent\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438924    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-kubernetes\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-etc-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.438998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-kube-api-access-mdtph\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441218 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.439060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-etc-openvswitch\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.439083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-system-cni-dir\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.439113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-sys-fs\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.439138    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/063389fa-2772-4bfc-b51a-1d25255c9a16-system-cni-dir\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.439223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-env-overrides\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.441092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/74da28f3-1cfe-41de-94ae-0b7f6f81c033-etc-tuned\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.441225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74da28f3-1cfe-41de-94ae-0b7f6f81c033-tmp\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.441786 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.441283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-ovn-node-metrics-cert\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.448224 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.448201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7pz\" (UniqueName: \"kubernetes.io/projected/063389fa-2772-4bfc-b51a-1d25255c9a16-kube-api-access-ld7pz\") pod \"multus-additional-cni-plugins-5dtwt\" (UID: \"063389fa-2772-4bfc-b51a-1d25255c9a16\") " pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.449093 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.449070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdtph\" (UniqueName: \"kubernetes.io/projected/24b19b15-9bf1-4c15-9b56-8253ab9ecc5d-kube-api-access-mdtph\") pod \"ovnkube-node-dgcgb\" (UID: \"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.450129 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.450108    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ntqk\" (UniqueName: \"kubernetes.io/projected/74da28f3-1cfe-41de-94ae-0b7f6f81c033-kube-api-access-6ntqk\") pod \"tuned-zkl2c\" (UID: \"74da28f3-1cfe-41de-94ae-0b7f6f81c033\") " pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.486418 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.486288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" event={"ID":"248d0f7e722cfd0e6b4146e47b156c9b","Type":"ContainerStarted","Data":"0aa06b9a09f54411d02b784600ff39d00d2143ba09bde67bd98dd2c6ab3fc7a7"}
Jul 31 21:36:16.487516 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.487492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" event={"ID":"70a151c6e1ba236684bfa7e6ef9cf985","Type":"ContainerStarted","Data":"69b13c12c6f91c3bd847191e558ad7c2afb37d92cca8d49fedaa02aab64e1c52"}
Jul 31 21:36:16.540189 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540159    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8467d52a-9653-4ace-850b-987fde89d0dc-agent-certs\") pod \"konnectivity-agent-lx5mt\" (UID: \"8467d52a-9653-4ace-850b-987fde89d0dc\") " pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.540320 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-multus-certs\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540320 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540229    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-k8s-cni-cncf-io\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540320 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540252    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-netns\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540320 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-kubelet\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540320 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-hostroot\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-etc-kubernetes\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-system-cni-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540377    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-os-release\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dw4z\" (UniqueName: \"kubernetes.io/projected/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-kube-api-access-2dw4z\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83b91889-0841-4386-bef9-29bf74a33547-dbus\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-socket-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-conf-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e26873ec-3dc3-4972-9966-c7ab244be462-hosts-file\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-cni-multus\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e26873ec-3dc3-4972-9966-c7ab244be462-tmp-dir\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.540586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58v22\" (UniqueName: \"kubernetes.io/projected/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-kube-api-access-58v22\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540603    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-socket-dir-parent\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-system-cni-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-sys-fs\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1895e645-ab01-4301-a95e-e1410723193a-host-slash\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-k8s-cni-cncf-io\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540707    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-socket-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540726    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-serviceca\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-netns\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540751    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-cni-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540780    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-kubelet\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-os-release\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-etc-kubernetes\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-cnibin\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540838    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-conf-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540866    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n62h5\" (UniqueName: \"kubernetes.io/projected/e26873ec-3dc3-4972-9966-c7ab244be462-kube-api-access-n62h5\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.541215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540907    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-cni-multus\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvx6b\" (UniqueName: \"kubernetes.io/projected/c9102a20-c095-41e5-9cce-5112fd032423-kube-api-access-hvx6b\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-cni-binary-copy\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-cni-bin\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-host\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83b91889-0841-4386-bef9-29bf74a33547-kubelet-config\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541084    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-device-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-etc-selinux\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxcm9\" (UniqueName: \"kubernetes.io/projected/1895e645-ab01-4301-a95e-e1410723193a-kube-api-access-nxcm9\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879rp\" (UniqueName: \"kubernetes.io/projected/309c3407-8711-4dfa-a4d6-7a8b438cf173-kube-api-access-879rp\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8467d52a-9653-4ace-850b-987fde89d0dc-konnectivity-ca\") pod \"konnectivity-agent-lx5mt\" (UID: \"8467d52a-9653-4ace-850b-987fde89d0dc\") " pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e26873ec-3dc3-4972-9966-c7ab244be462-tmp-dir\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.541343    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.541441    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:17.041418485 +0000 UTC m=+3.124427293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:16.542064 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-hostroot\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541479    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83b91889-0841-4386-bef9-29bf74a33547-dbus\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541539    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-cnibin\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-device-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540931    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e26873ec-3dc3-4972-9966-c7ab244be462-hosts-file\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-etc-selinux\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-daemon-config\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-socket-dir-parent\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542109    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-cni-binary-copy\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542161    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1895e645-ab01-4301-a95e-e1410723193a-host-slash\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.540669    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-run-multus-certs\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542182    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-host-var-lib-cni-bin\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542230    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-host\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.542252    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83b91889-0841-4386-bef9-29bf74a33547-kubelet-config\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.542299    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:17.042283906 +0000 UTC m=+3.125292691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-sys-fs\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.542953 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.541240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-daemon-config\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1895e645-ab01-4301-a95e-e1410723193a-iptables-alerter-script\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542589    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-registration-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/309c3407-8711-4dfa-a4d6-7a8b438cf173-registration-dir\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542716    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-multus-cni-dir\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542747    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-serviceca\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.542855    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8467d52a-9653-4ace-850b-987fde89d0dc-konnectivity-ca\") pod \"konnectivity-agent-lx5mt\" (UID: \"8467d52a-9653-4ace-850b-987fde89d0dc\") " pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.543843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.543238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1895e645-ab01-4301-a95e-e1410723193a-iptables-alerter-script\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.545366 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.545321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8467d52a-9653-4ace-850b-987fde89d0dc-agent-certs\") pod \"konnectivity-agent-lx5mt\" (UID: \"8467d52a-9653-4ace-850b-987fde89d0dc\") " pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.556443 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.556386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvx6b\" (UniqueName: \"kubernetes.io/projected/c9102a20-c095-41e5-9cce-5112fd032423-kube-api-access-hvx6b\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:16.557021 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.556865    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:16.557021 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.556886    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:16.557021 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.556901    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:16.557021 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:16.556952    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:17.056936069 +0000 UTC m=+3.139944855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:16.558543 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.558517    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58v22\" (UniqueName: \"kubernetes.io/projected/8e7010c1-229b-46d3-85f2-ce1e92ab2d46-kube-api-access-58v22\") pod \"node-ca-ntbwp\" (UID: \"8e7010c1-229b-46d3-85f2-ce1e92ab2d46\") " pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.558860 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.558836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n62h5\" (UniqueName: \"kubernetes.io/projected/e26873ec-3dc3-4972-9966-c7ab244be462-kube-api-access-n62h5\") pod \"node-resolver-z29n6\" (UID: \"e26873ec-3dc3-4972-9966-c7ab244be462\") " pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.559071 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.559042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxcm9\" (UniqueName: \"kubernetes.io/projected/1895e645-ab01-4301-a95e-e1410723193a-kube-api-access-nxcm9\") pod \"iptables-alerter-4qpfs\" (UID: \"1895e645-ab01-4301-a95e-e1410723193a\") " pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.559396 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.559371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dw4z\" (UniqueName: \"kubernetes.io/projected/d642f5e2-7a0b-4080-95c5-8bf35ca48c57-kube-api-access-2dw4z\") pod \"multus-tvp9k\" (UID: \"d642f5e2-7a0b-4080-95c5-8bf35ca48c57\") " pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:16.559591 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.559524    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-879rp\" (UniqueName: \"kubernetes.io/projected/309c3407-8711-4dfa-a4d6-7a8b438cf173-kube-api-access-879rp\") pod \"aws-ebs-csi-driver-node-rdwl5\" (UID: \"309c3407-8711-4dfa-a4d6-7a8b438cf173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.637099 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.637072    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:16.645494 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.645469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5dtwt"
Jul 31 21:36:16.648071 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.648050    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:16.660100 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.660080    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zkl2c"
Jul 31 21:36:16.667119 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.667099    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z29n6"
Jul 31 21:36:16.674865 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.674846    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4qpfs"
Jul 31 21:36:16.683785 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.683768    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5"
Jul 31 21:36:16.691628 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.691610    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ntbwp"
Jul 31 21:36:16.700307 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.700278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:16.707209 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:16.707184    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tvp9k"
Jul 31 21:36:17.046080 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:17.045992    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:17.046080 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:17.046048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:17.046290 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.046144    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:17.046290 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.046219    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:18.046203584 +0000 UTC m=+4.129212367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:17.046290 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.046152    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:17.046290 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.046279    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:18.046267599 +0000 UTC m=+4.129276382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:17.147381 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:17.147342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:17.147538 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.147507    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:17.147538 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.147533    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:17.147632 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.147548    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:17.147632 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:17.147624    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:18.147603507 +0000 UTC m=+4.230612297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:17.311912 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:17.311841    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:36:17.392464 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:17.392415    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:31:17 +0000 UTC" deadline="2028-02-12 15:35:03.132895379 +0000 UTC"
Jul 31 21:36:17.392464 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:17.392458    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13457h58m45.740439673s"
Jul 31 21:36:17.588553 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.588525    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b19b15_9bf1_4c15_9b56_8253ab9ecc5d.slice/crio-b4772dcc72cc4c73dbe489f914efcfcafcede5e7518ed05e68dbd3ecef95db62 WatchSource:0}: Error finding container b4772dcc72cc4c73dbe489f914efcfcafcede5e7518ed05e68dbd3ecef95db62: Status 404 returned error can't find the container with id b4772dcc72cc4c73dbe489f914efcfcafcede5e7518ed05e68dbd3ecef95db62
Jul 31 21:36:17.590699 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.590605    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063389fa_2772_4bfc_b51a_1d25255c9a16.slice/crio-ab726080dcea8a77ec4ee53fe47753e86e91324ddc51bdd245fa79468aa2e431 WatchSource:0}: Error finding container ab726080dcea8a77ec4ee53fe47753e86e91324ddc51bdd245fa79468aa2e431: Status 404 returned error can't find the container with id ab726080dcea8a77ec4ee53fe47753e86e91324ddc51bdd245fa79468aa2e431
Jul 31 21:36:17.593516 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.593490    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8467d52a_9653_4ace_850b_987fde89d0dc.slice/crio-36feb2e139c7391e12c161024e18969a3b1dea9d62b1b3b9ca86479fc95489eb WatchSource:0}: Error finding container 36feb2e139c7391e12c161024e18969a3b1dea9d62b1b3b9ca86479fc95489eb: Status 404 returned error can't find the container with id 36feb2e139c7391e12c161024e18969a3b1dea9d62b1b3b9ca86479fc95489eb
Jul 31 21:36:17.594504 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.594482    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26873ec_3dc3_4972_9966_c7ab244be462.slice/crio-20b287f4d065b2def5b17b7fde9fac2d4e0832648b36cb15c0a0873f789232a7 WatchSource:0}: Error finding container 20b287f4d065b2def5b17b7fde9fac2d4e0832648b36cb15c0a0873f789232a7: Status 404 returned error can't find the container with id 20b287f4d065b2def5b17b7fde9fac2d4e0832648b36cb15c0a0873f789232a7
Jul 31 21:36:17.617418 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.617393    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74da28f3_1cfe_41de_94ae_0b7f6f81c033.slice/crio-8e25b85b3c142c1de4ace958c3201ec6956a7c83abaee5d9ce87acb036bdf91f WatchSource:0}: Error finding container 8e25b85b3c142c1de4ace958c3201ec6956a7c83abaee5d9ce87acb036bdf91f: Status 404 returned error can't find the container with id 8e25b85b3c142c1de4ace958c3201ec6956a7c83abaee5d9ce87acb036bdf91f
Jul 31 21:36:17.618163 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.618109    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd642f5e2_7a0b_4080_95c5_8bf35ca48c57.slice/crio-4f3d862ddc43a65e77e2965e1ad26dbe66543dd962f519ec8f90ebe71c1c1c9f WatchSource:0}: Error finding container 4f3d862ddc43a65e77e2965e1ad26dbe66543dd962f519ec8f90ebe71c1c1c9f: Status 404 returned error can't find the container with id 4f3d862ddc43a65e77e2965e1ad26dbe66543dd962f519ec8f90ebe71c1c1c9f
Jul 31 21:36:17.619681 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.619375    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7010c1_229b_46d3_85f2_ce1e92ab2d46.slice/crio-514262c83a18eeec6db66b6f2d3cf2dae37510acd3751d296711fa677864e1c7 WatchSource:0}: Error finding container 514262c83a18eeec6db66b6f2d3cf2dae37510acd3751d296711fa677864e1c7: Status 404 returned error can't find the container with id 514262c83a18eeec6db66b6f2d3cf2dae37510acd3751d296711fa677864e1c7
Jul 31 21:36:17.620157 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.619968    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1895e645_ab01_4301_a95e_e1410723193a.slice/crio-811dcfd577ac870709e187684656a17e0d148e499f5bc66980fbf8330c737092 WatchSource:0}: Error finding container 811dcfd577ac870709e187684656a17e0d148e499f5bc66980fbf8330c737092: Status 404 returned error can't find the container with id 811dcfd577ac870709e187684656a17e0d148e499f5bc66980fbf8330c737092
Jul 31 21:36:17.621520 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:17.621494    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309c3407_8711_4dfa_a4d6_7a8b438cf173.slice/crio-d2d4f9199555564726018c08369608b59d17fd2848752db9399327b5710a3322 WatchSource:0}: Error finding container d2d4f9199555564726018c08369608b59d17fd2848752db9399327b5710a3322: Status 404 returned error can't find the container with id d2d4f9199555564726018c08369608b59d17fd2848752db9399327b5710a3322
Jul 31 21:36:18.054374 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.054106    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:18.054564 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.054413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:18.054628 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.054561    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:18.054628 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.054623    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:20.054605468 +0000 UTC m=+6.137614257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:18.054748 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.054562    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:18.054748 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.054709    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:20.054695004 +0000 UTC m=+6.137703793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:18.155385 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.155282    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:18.155554 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.155464    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:18.155554 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.155486    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:18.155554 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.155500    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:18.155726 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.155562    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:20.155541933 +0000 UTC m=+6.238550738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:18.393670 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.393611    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:31:17 +0000 UTC" deadline="2028-03-14 02:51:54.137496385 +0000 UTC"
Jul 31 21:36:18.393670 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.393650    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14189h15m35.743851335s"
Jul 31 21:36:18.484199 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.483284    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:18.484199 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.483441    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:18.484199 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.483846    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:18.484199 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.483941    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:18.484199 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.484002    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:18.484199 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:18.484095    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:18.498636 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.498566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4qpfs" event={"ID":"1895e645-ab01-4301-a95e-e1410723193a","Type":"ContainerStarted","Data":"811dcfd577ac870709e187684656a17e0d148e499f5bc66980fbf8330c737092"}
Jul 31 21:36:18.506225 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.506190    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z29n6" event={"ID":"e26873ec-3dc3-4972-9966-c7ab244be462","Type":"ContainerStarted","Data":"20b287f4d065b2def5b17b7fde9fac2d4e0832648b36cb15c0a0873f789232a7"}
Jul 31 21:36:18.518359 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.518252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lx5mt" event={"ID":"8467d52a-9653-4ace-850b-987fde89d0dc","Type":"ContainerStarted","Data":"36feb2e139c7391e12c161024e18969a3b1dea9d62b1b3b9ca86479fc95489eb"}
Jul 31 21:36:18.529110 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.529081    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerStarted","Data":"ab726080dcea8a77ec4ee53fe47753e86e91324ddc51bdd245fa79468aa2e431"}
Jul 31 21:36:18.548623 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.548595    2557 generic.go:356] "Generic (PLEG): container finished" podID="248d0f7e722cfd0e6b4146e47b156c9b" containerID="7672f999086af9506ab769ad87257aee605fbd543f4d7341e5c02ad29d0fd3f1" exitCode=0
Jul 31 21:36:18.548721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.548686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" event={"ID":"248d0f7e722cfd0e6b4146e47b156c9b","Type":"ContainerDied","Data":"7672f999086af9506ab769ad87257aee605fbd543f4d7341e5c02ad29d0fd3f1"}
Jul 31 21:36:18.564412 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.564383    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ntbwp" event={"ID":"8e7010c1-229b-46d3-85f2-ce1e92ab2d46","Type":"ContainerStarted","Data":"514262c83a18eeec6db66b6f2d3cf2dae37510acd3751d296711fa677864e1c7"}
Jul 31 21:36:18.576932 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.576907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"b4772dcc72cc4c73dbe489f914efcfcafcede5e7518ed05e68dbd3ecef95db62"}
Jul 31 21:36:18.589608 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.589582    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" event={"ID":"70a151c6e1ba236684bfa7e6ef9cf985","Type":"ContainerStarted","Data":"0d39057fd8d897e07f69e90a15234b4e77f18eef580506990119d4439f6f5995"}
Jul 31 21:36:18.593646 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.593613    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5" event={"ID":"309c3407-8711-4dfa-a4d6-7a8b438cf173","Type":"ContainerStarted","Data":"d2d4f9199555564726018c08369608b59d17fd2848752db9399327b5710a3322"}
Jul 31 21:36:18.613903 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.613775    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvp9k" event={"ID":"d642f5e2-7a0b-4080-95c5-8bf35ca48c57","Type":"ContainerStarted","Data":"4f3d862ddc43a65e77e2965e1ad26dbe66543dd962f519ec8f90ebe71c1c1c9f"}
Jul 31 21:36:18.614441 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.614393    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" podStartSLOduration=2.614375701 podStartE2EDuration="2.614375701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:18.613641857 +0000 UTC m=+4.696650666" watchObservedRunningTime="2026-07-31 21:36:18.614375701 +0000 UTC m=+4.697384511"
Jul 31 21:36:18.642842 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:18.642794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zkl2c" event={"ID":"74da28f3-1cfe-41de-94ae-0b7f6f81c033","Type":"ContainerStarted","Data":"8e25b85b3c142c1de4ace958c3201ec6956a7c83abaee5d9ce87acb036bdf91f"}
Jul 31 21:36:19.664502 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:19.664465    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" event={"ID":"248d0f7e722cfd0e6b4146e47b156c9b","Type":"ContainerStarted","Data":"7f65464239612ca05cf84302470dfdb0446a624db493ba72aa618433fbf81f7c"}
Jul 31 21:36:19.683849 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:19.683399    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" podStartSLOduration=3.683378651 podStartE2EDuration="3.683378651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:19.682543937 +0000 UTC m=+5.765552747" watchObservedRunningTime="2026-07-31 21:36:19.683378651 +0000 UTC m=+5.766387460"
Jul 31 21:36:20.072591 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:20.072397    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:20.072591 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:20.072456    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:20.072591 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.072557    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:20.072911 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.072644    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:24.072622708 +0000 UTC m=+10.155631496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:20.072999 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.072564    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:20.073103 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.073059    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:24.073037 +0000 UTC m=+10.156045788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:20.173151 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:20.173112    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:20.173326 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.173290    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:20.173326 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.173311    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:20.173326 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.173323    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:20.173498 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.173392    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:24.173365323 +0000 UTC m=+10.256381361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:20.482214 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:20.482133    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:20.482374 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.482286    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:20.482871 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:20.482694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:20.482871 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.482785    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:20.482871 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:20.482823    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:20.483257 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:20.482909    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:22.480561 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:22.480528    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:22.480966 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:22.480724    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:22.480966 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:22.480717    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:22.480966 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:22.480874    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:22.480966 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:22.480925    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:22.481208 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:22.481009    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:24.108501 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:24.108460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:24.108976 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:24.108533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:24.108976 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.108712    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:24.108976 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.108771    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:32.108752415 +0000 UTC m=+18.191761202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:24.108976 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.108947    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:24.109198 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.108996    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:32.108980891 +0000 UTC m=+18.191989689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:24.210123 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:24.209433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:24.210123 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.209641    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:24.210123 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.209664    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:24.210123 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.209677    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:24.210123 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.209732    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:32.209714222 +0000 UTC m=+18.292723024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:24.481500 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:24.481420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:24.481673 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:24.481504    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:24.481673 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.481517    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:24.481673 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.481617    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:24.481673 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:24.481629    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:24.481895 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:24.481772    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:26.482357 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:26.481290    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:26.482357 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:26.481458    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:26.482357 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:26.481842    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:26.482357 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:26.481971    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:26.482357 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:26.482024    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:26.482357 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:26.482089    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:28.480778 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:28.480752    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:28.481274 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:28.480753    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:28.481274 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:28.480853    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:28.481274 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:28.480915    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:28.481274 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:28.480994    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:28.481274 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:28.481082    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:30.481134 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:30.481096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:30.481134 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:30.481130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:30.481629 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:30.481101    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:30.481629 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:30.481234    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:30.481629 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:30.481281    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:30.481629 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:30.481389    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:32.174434 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:32.174401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:32.174434 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:32.174439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:32.174891 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.174532    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:32.174891 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.174534    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:32.174891 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.174575    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:48.174564177 +0000 UTC m=+34.257572959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:32.174891 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.174589    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:48.174582766 +0000 UTC m=+34.257591548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:32.274896 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:32.274867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:32.275043 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.275025    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:32.275117 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.275044    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:32.275117 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.275057    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:32.275216 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.275129    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:48.275109217 +0000 UTC m=+34.358118016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:32.480628 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:32.480550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:32.480774 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:32.480550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:32.480774 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.480671    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:32.480774 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:32.480681    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:32.480927 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.480780    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:32.480927 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:32.480844    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:34.481893 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:34.481852    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:34.482298 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:34.481984    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:34.482298 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:34.482012    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:34.482298 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:34.482029    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:34.482298 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:34.482108    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:34.482298 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:34.482162    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:36.481459 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.481208    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:36.482097 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.481226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:36.482097 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:36.481558    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:36.482097 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:36.481640    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:36.482097 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.481346    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:36.482097 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:36.481741    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:36.699283 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.699177    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5" event={"ID":"309c3407-8711-4dfa-a4d6-7a8b438cf173","Type":"ContainerStarted","Data":"a004d3e4d1ff1e525dc96bb279fe290592e4e82cebe2db457a7ff5eff279cf4d"}
Jul 31 21:36:36.701080 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.701054    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tvp9k" event={"ID":"d642f5e2-7a0b-4080-95c5-8bf35ca48c57","Type":"ContainerStarted","Data":"763c07b68722ccb7d5e73c5662d404fa57104cb46080fd50cf78e6306180de9e"}
Jul 31 21:36:36.703026 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.703000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zkl2c" event={"ID":"74da28f3-1cfe-41de-94ae-0b7f6f81c033","Type":"ContainerStarted","Data":"a2c046c8cbc427a279b808a4edb5c3b80d0bfa2512be5250112f7d10aa45982b"}
Jul 31 21:36:36.704512 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.704482    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z29n6" event={"ID":"e26873ec-3dc3-4972-9966-c7ab244be462","Type":"ContainerStarted","Data":"387a73c101d8d9e44e55c6f760027e04653de936a5e7aa07af8047d15845278a"}
Jul 31 21:36:36.709476 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.709451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lx5mt" event={"ID":"8467d52a-9653-4ace-850b-987fde89d0dc","Type":"ContainerStarted","Data":"292de703eff169aa3402d2870c903f4ac6a0972385312690fd10a6cd743b870e"}
Jul 31 21:36:36.710983 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.710940    2557 generic.go:356] "Generic (PLEG): container finished" podID="063389fa-2772-4bfc-b51a-1d25255c9a16" containerID="43bfbd60f442516dc4638cc999ed4b697e0ae6918a21b5436afa8e3a990fc6b9" exitCode=0
Jul 31 21:36:36.711080 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.710998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerDied","Data":"43bfbd60f442516dc4638cc999ed4b697e0ae6918a21b5436afa8e3a990fc6b9"}
Jul 31 21:36:36.712656 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.712633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ntbwp" event={"ID":"8e7010c1-229b-46d3-85f2-ce1e92ab2d46","Type":"ContainerStarted","Data":"1256307931a323607080360e7fa64591f4f10fab0f5732d03a2f64c9e3a4cded"}
Jul 31 21:36:36.716015 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.715998    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:36:36.716324 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716304    2557 generic.go:356] "Generic (PLEG): container finished" podID="24b19b15-9bf1-4c15-9b56-8253ab9ecc5d" containerID="2d9a517e2354f8d77cf713863b15d301b14cc14876b12d15807ac3032942896d" exitCode=1
Jul 31 21:36:36.716417 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716336    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"dcacc64ed6161c39cb9a3e994d0e9dc8457a8ddeef4769acd6fc0a7bdcd85e76"}
Jul 31 21:36:36.716417 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"61b2788cbaf71ecd6e18497bdd423464ded109187ec4b48605390836ca73f7c8"}
Jul 31 21:36:36.716522 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716446    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"936e9b5893fa1bf9d1f930f8349b0dbe15416ca2a5f8c22a713f4c1f30c2f288"}
Jul 31 21:36:36.716522 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716495    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"705792c1d4bde54860609b96e14ff3ccc0eab0d943a80f57602edd0f697ceb49"}
Jul 31 21:36:36.716619 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerDied","Data":"2d9a517e2354f8d77cf713863b15d301b14cc14876b12d15807ac3032942896d"}
Jul 31 21:36:36.716619 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.716591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"cb75f09c4c0fa4c093fe2f7b0fc5be027920ed78975a4a7c374521ddb5857de5"}
Jul 31 21:36:36.722347 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.722316    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tvp9k" podStartSLOduration=2.894312598 podStartE2EDuration="21.722305383s" totalImagesPullingTime="18.827992785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:36.721927498 +0000 UTC m=+22.804936304" watchObservedRunningTime="2026-07-31 21:36:36.722305383 +0000 UTC m=+22.805314186"
Jul 31 21:36:36.739291 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.739249    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ntbwp" podStartSLOduration=3.351985141 podStartE2EDuration="21.739231836s" totalImagesPullingTime="18.387246695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:36.738988814 +0000 UTC m=+22.821997618" watchObservedRunningTime="2026-07-31 21:36:36.739231836 +0000 UTC m=+22.822240641"
Jul 31 21:36:36.783424 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.783392    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lx5mt" podStartSLOduration=3.387491377 podStartE2EDuration="21.783380622s" totalImagesPullingTime="18.395889245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:36.754970834 +0000 UTC m=+22.837979630" watchObservedRunningTime="2026-07-31 21:36:36.783380622 +0000 UTC m=+22.866389443"
Jul 31 21:36:36.804488 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.804451    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zkl2c" podStartSLOduration=3.386425203 podStartE2EDuration="21.80443585s" totalImagesPullingTime="18.418010647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:36.804415185 +0000 UTC m=+22.887423989" watchObservedRunningTime="2026-07-31 21:36:36.80443585 +0000 UTC m=+22.887444656"
Jul 31 21:36:36.820473 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:36.820444    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z29n6" podStartSLOduration=3.396722442 podStartE2EDuration="21.820432527s" totalImagesPullingTime="18.423710085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:36.82041073 +0000 UTC m=+22.903419653" watchObservedRunningTime="2026-07-31 21:36:36.820432527 +0000 UTC m=+22.903441331"
Jul 31 21:36:37.009898 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.009812    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:37.010439 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.010421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:37.569856 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.569832    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 21:36:37.721074 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.720998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5" event={"ID":"309c3407-8711-4dfa-a4d6-7a8b438cf173","Type":"ContainerStarted","Data":"60a2c3cfcc044ed623f1fe78e8aa999c6bdc61a74f6547e46aea5fef79ef35d8"}
Jul 31 21:36:37.722673 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.722561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4qpfs" event={"ID":"1895e645-ab01-4301-a95e-e1410723193a","Type":"ContainerStarted","Data":"c9d44a873fe177eafcbfd825a47846472c4df9c409619bdd4bb9fb626d989352"}
Jul 31 21:36:37.723658 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.723636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:37.723812 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.723702    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lx5mt"
Jul 31 21:36:37.741216 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:37.741170    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4qpfs" podStartSLOduration=4.327212542 podStartE2EDuration="22.741151566s" totalImagesPullingTime="18.413939024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:37.740836097 +0000 UTC m=+23.823844901" watchObservedRunningTime="2026-07-31 21:36:37.741151566 +0000 UTC m=+23.824160370"
Jul 31 21:36:38.386624 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:38.386533    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T21:36:37.569848188Z","UUID":"f55b7eb2-578f-48ed-a097-cb34c377626a","Handler":null,"Name":"","Endpoint":""}
Jul 31 21:36:38.388275 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:38.388248    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 21:36:38.388405 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:38.388300    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 21:36:38.481345 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:38.481318    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:38.481345 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:38.481332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:38.481555 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:38.481429    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:38.481555 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:38.481523    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:38.481635 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:38.481585    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:38.481674 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:38.481662    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:39.730445 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:39.730261    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:36:39.730936 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:39.730870    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"a92e10779c84437ae171c895a3745324089e2bf283d7d738f7ab83013c2e3fe5"}
Jul 31 21:36:39.733034 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:39.733000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5" event={"ID":"309c3407-8711-4dfa-a4d6-7a8b438cf173","Type":"ContainerStarted","Data":"dc458045d3f4257f1efff49973b5dd6be1b47e97fb2ba42616db8fced3acb7bf"}
Jul 31 21:36:39.753448 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:39.753407    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rdwl5" podStartSLOduration=3.953867652 podStartE2EDuration="24.753391276s" totalImagesPullingTime="20.799523624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:39.752976064 +0000 UTC m=+25.835984871" watchObservedRunningTime="2026-07-31 21:36:39.753391276 +0000 UTC m=+25.836400081"
Jul 31 21:36:40.480715 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:40.480686    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:40.480926 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:40.480686    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:40.480926 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:40.480810    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:40.480926 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:40.480805    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:40.480926 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:40.480908    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:40.481157 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:40.480995    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:41.739174 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.738899    2557 generic.go:356] "Generic (PLEG): container finished" podID="063389fa-2772-4bfc-b51a-1d25255c9a16" containerID="6b56386d20633144d818ec05cb3696220ed8c317bbf00a8c0289e69d870550e0" exitCode=0
Jul 31 21:36:41.739902 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.738975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerDied","Data":"6b56386d20633144d818ec05cb3696220ed8c317bbf00a8c0289e69d870550e0"}
Jul 31 21:36:41.742686 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.742583    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:36:41.742914 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.742892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"a08a69d1c2b01d2c2364e7f08de549a0fcc26c2c930d6723293bb702e5a8ee3e"}
Jul 31 21:36:41.743182 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.743164    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:41.743257 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.743219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:41.743321 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.743307    2557 scope.go:117] "RemoveContainer" containerID="2d9a517e2354f8d77cf713863b15d301b14cc14876b12d15807ac3032942896d"
Jul 31 21:36:41.758604 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:41.758586    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:42.480855 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.480826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:42.481065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.480826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:42.481065 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:42.480923    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:42.481065 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.480826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:42.481217 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:42.481148    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:42.481217 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:42.481036    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:42.749043 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.748985    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:36:42.749517 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.749349    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" event={"ID":"24b19b15-9bf1-4c15-9b56-8253ab9ecc5d","Type":"ContainerStarted","Data":"c8e36412f5f6301c46f2eab9c7934a8bab2a307404072f084f3fb97051372e19"}
Jul 31 21:36:42.749685 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.749664    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:42.765681 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.765657    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:36:42.781906 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:42.781839    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb" podStartSLOduration=9.283364023 podStartE2EDuration="27.781819078s" totalImagesPullingTime="18.498455055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:42.779037545 +0000 UTC m=+28.862046351" watchObservedRunningTime="2026-07-31 21:36:42.781819078 +0000 UTC m=+28.864827883"
Jul 31 21:36:43.024229 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.024085    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kv9ct"]
Jul 31 21:36:43.024353 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.024336    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:43.024445 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:43.024426    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:43.026807 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.026785    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5cv2k"]
Jul 31 21:36:43.026929 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.026875    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:43.027008 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:43.026988    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:43.027514 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.027490    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qnwl6"]
Jul 31 21:36:43.027621 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.027588    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:43.027711 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:43.027687    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:43.753179 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.753148    2557 generic.go:356] "Generic (PLEG): container finished" podID="063389fa-2772-4bfc-b51a-1d25255c9a16" containerID="b619bd889e93795f945de2473a2e0c57b53aea88ec2a947cb186f658e89ff476" exitCode=0
Jul 31 21:36:43.753598 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:43.753224    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerDied","Data":"b619bd889e93795f945de2473a2e0c57b53aea88ec2a947cb186f658e89ff476"}
Jul 31 21:36:44.481488 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:44.481458    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:44.481665 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:44.481545    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:44.481665 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:44.481617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:44.481749 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:44.481712    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:44.481749 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:44.481744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:44.481810 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:44.481790    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:45.762413 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:45.762383    2557 generic.go:356] "Generic (PLEG): container finished" podID="063389fa-2772-4bfc-b51a-1d25255c9a16" containerID="808a029628ca7f5ee737b43c1d386aca4ed5bb88cb1986e04044852e18d6fd05" exitCode=0
Jul 31 21:36:45.762985 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:45.762436    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerDied","Data":"808a029628ca7f5ee737b43c1d386aca4ed5bb88cb1986e04044852e18d6fd05"}
Jul 31 21:36:46.481246 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:46.481215    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:46.481422 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:46.481215    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:46.481422 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:46.481343    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:46.481422 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:46.481414    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:46.481570 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:46.481215    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:46.481570 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:46.481496    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:48.199999 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:48.199968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:48.200436 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:48.200010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:48.200436 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.200059    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:48.200436 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.200113    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs podName:c9102a20-c095-41e5-9cce-5112fd032423 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:20.200098944 +0000 UTC m=+66.283107726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs") pod "network-metrics-daemon-qnwl6" (UID: "c9102a20-c095-41e5-9cce-5112fd032423") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:36:48.200436 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.200150    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:48.200436 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.200205    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret podName:83b91889-0841-4386-bef9-29bf74a33547 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:20.200192569 +0000 UTC m=+66.283201351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret") pod "global-pull-secret-syncer-kv9ct" (UID: "83b91889-0841-4386-bef9-29bf74a33547") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:36:48.301127 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:48.301096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:48.301286 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.301241    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:36:48.301286 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.301258    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:36:48.301286 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.301267    2557 projected.go:196] Error preparing data for projected volume kube-api-access-6dm62 for pod openshift-network-diagnostics/network-check-target-5cv2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:48.301446 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.301313    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62 podName:b7ccf582-7e2c-4cba-8018-196b525e3ca0 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:20.301299869 +0000 UTC m=+66.384308652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6dm62" (UniqueName: "kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62") pod "network-check-target-5cv2k" (UID: "b7ccf582-7e2c-4cba-8018-196b525e3ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:36:48.480829 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:48.480759    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:48.480986 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:48.480759    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:48.480986 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.480863    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cv2k" podUID="b7ccf582-7e2c-4cba-8018-196b525e3ca0"
Jul 31 21:36:48.480986 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.480936    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnwl6" podUID="c9102a20-c095-41e5-9cce-5112fd032423"
Jul 31 21:36:48.480986 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:48.480980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:48.481148 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:48.481060    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv9ct" podUID="83b91889-0841-4386-bef9-29bf74a33547"
Jul 31 21:36:49.264647 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.264562    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeReady"
Jul 31 21:36:49.265105 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.264701    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 21:36:49.343691 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.343659    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v9phl"]
Jul 31 21:36:49.345984 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.345946    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.349870 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.349822    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 21:36:49.350598 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.350572    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vzfj5\""
Jul 31 21:36:49.350682 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.350576    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 21:36:49.351162 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.351134    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 21:36:49.351345 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.351326    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dkgq2"]
Jul 31 21:36:49.353365 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.353347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.357746 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.357730    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 21:36:49.358426 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.358411    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 21:36:49.359101 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.359068    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 21:36:49.359209 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.359191    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 21:36:49.363330 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.363313    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zkn8l\""
Jul 31 21:36:49.370442 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.370421    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v9phl"]
Jul 31 21:36:49.373505 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.373484    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dkgq2"]
Jul 31 21:36:49.384024 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.384002    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rt8z4"]
Jul 31 21:36:49.385584 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.385566    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.388167 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.388149    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 21:36:49.388382 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.388360    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 21:36:49.388579 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.388563    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jgwbq\""
Jul 31 21:36:49.396932 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.396911    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rt8z4"]
Jul 31 21:36:49.512271 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.512271 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512273    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512296    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk2r7\" (UniqueName: \"kubernetes.io/projected/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-api-access-xk2r7\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8wx\" (UniqueName: \"kubernetes.io/projected/d26c839e-e9b1-4a26-98ba-3a55239e7e96-kube-api-access-ng8wx\") pod \"ingress-canary-v9phl\" (UID: \"d26c839e-e9b1-4a26-98ba-3a55239e7e96\") " pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-tmp-dir\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512386    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d26c839e-e9b1-4a26-98ba-3a55239e7e96-cert\") pod \"ingress-canary-v9phl\" (UID: \"d26c839e-e9b1-4a26-98ba-3a55239e7e96\") " pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512431    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9d9\" (UniqueName: \"kubernetes.io/projected/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-kube-api-access-md9d9\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512457    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-config-volume\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.512475 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512474    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.512728 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ead0a0c8-0dbb-4679-82b4-f09325572918-crio-socket\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.512728 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.512518    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ead0a0c8-0dbb-4679-82b4-f09325572918-data-volume\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.613375 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.613375 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.613375 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk2r7\" (UniqueName: \"kubernetes.io/projected/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-api-access-xk2r7\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8wx\" (UniqueName: \"kubernetes.io/projected/d26c839e-e9b1-4a26-98ba-3a55239e7e96-kube-api-access-ng8wx\") pod \"ingress-canary-v9phl\" (UID: \"d26c839e-e9b1-4a26-98ba-3a55239e7e96\") " pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-tmp-dir\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:49.613436    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:49.613448    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:49.613514    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:50.113494702 +0000 UTC m=+36.196503488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : configmap "kube-rbac-proxy" not found
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:49.613532    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls podName:3450f80f-b1df-4fd3-b807-784ac3cbcdd1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:50.113523995 +0000 UTC m=+36.196532794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls") pod "dns-default-rt8z4" (UID: "3450f80f-b1df-4fd3-b807-784ac3cbcdd1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d26c839e-e9b1-4a26-98ba-3a55239e7e96-cert\") pod \"ingress-canary-v9phl\" (UID: \"d26c839e-e9b1-4a26-98ba-3a55239e7e96\") " pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613595    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md9d9\" (UniqueName: \"kubernetes.io/projected/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-kube-api-access-md9d9\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.613632 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-config-volume\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-tmp-dir\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ead0a0c8-0dbb-4679-82b4-f09325572918-crio-socket\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:49.613796    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ead0a0c8-0dbb-4679-82b4-f09325572918-data-volume\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:49.613863    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:50.113839659 +0000 UTC m=+36.196848451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.613911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ead0a0c8-0dbb-4679-82b4-f09325572918-crio-socket\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.614116 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.614067    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-mbq7w"]
Jul 31 21:36:49.614419 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.614165    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ead0a0c8-0dbb-4679-82b4-f09325572918-data-volume\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.614419 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.614214    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-config-volume\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.615902 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.615883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.618365 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.618215    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d26c839e-e9b1-4a26-98ba-3a55239e7e96-cert\") pod \"ingress-canary-v9phl\" (UID: \"d26c839e-e9b1-4a26-98ba-3a55239e7e96\") " pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.618591 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.618577    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fkjjs\""
Jul 31 21:36:49.618654 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.618610    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 31 21:36:49.622179 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.619218    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 31 21:36:49.622179 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.619269    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 31 21:36:49.622179 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.619293    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 31 21:36:49.628485 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.628357    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-mbq7w"]
Jul 31 21:36:49.632248 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.631692    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9d9\" (UniqueName: \"kubernetes.io/projected/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-kube-api-access-md9d9\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:49.632248 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.631847    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk2r7\" (UniqueName: \"kubernetes.io/projected/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-api-access-xk2r7\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:49.632248 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.631921    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8wx\" (UniqueName: \"kubernetes.io/projected/d26c839e-e9b1-4a26-98ba-3a55239e7e96-kube-api-access-ng8wx\") pod \"ingress-canary-v9phl\" (UID: \"d26c839e-e9b1-4a26-98ba-3a55239e7e96\") " pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.657449 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.657423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v9phl"
Jul 31 21:36:49.715052 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.715025    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49b23752-232d-4f14-9109-30bcb1965a06-signing-cabundle\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.715146 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.715062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4mpt\" (UniqueName: \"kubernetes.io/projected/49b23752-232d-4f14-9109-30bcb1965a06-kube-api-access-f4mpt\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.715215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.715187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49b23752-232d-4f14-9109-30bcb1965a06-signing-key\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.816066 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.816036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49b23752-232d-4f14-9109-30bcb1965a06-signing-cabundle\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.816225 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.816079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4mpt\" (UniqueName: \"kubernetes.io/projected/49b23752-232d-4f14-9109-30bcb1965a06-kube-api-access-f4mpt\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.816225 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.816154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49b23752-232d-4f14-9109-30bcb1965a06-signing-key\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.816781 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.816753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49b23752-232d-4f14-9109-30bcb1965a06-signing-cabundle\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.819172 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.819129    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49b23752-232d-4f14-9109-30bcb1965a06-signing-key\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.825086 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.825067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4mpt\" (UniqueName: \"kubernetes.io/projected/49b23752-232d-4f14-9109-30bcb1965a06-kube-api-access-f4mpt\") pod \"service-ca-98c88fbb5-mbq7w\" (UID: \"49b23752-232d-4f14-9109-30bcb1965a06\") " pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:49.932457 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:49.932357    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w"
Jul 31 21:36:50.119020 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.118997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:50.119122 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.119092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:50.119181 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.119120    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:50.119181 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:50.119139    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:50.119274 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:50.119202    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:51.119187582 +0000 UTC m=+37.202196364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:50.119274 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:50.119225    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:50.119274 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:50.119240    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 21:36:50.119381 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:50.119281    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls podName:3450f80f-b1df-4fd3-b807-784ac3cbcdd1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:51.119268681 +0000 UTC m=+37.202277467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls") pod "dns-default-rt8z4" (UID: "3450f80f-b1df-4fd3-b807-784ac3cbcdd1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:50.119381 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:50.119293    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:51.119287503 +0000 UTC m=+37.202296285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : configmap "kube-rbac-proxy" not found
Jul 31 21:36:50.132057 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.132035    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v9phl"]
Jul 31 21:36:50.133149 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.133129    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-mbq7w"]
Jul 31 21:36:50.135151 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:50.135117    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b23752_232d_4f14_9109_30bcb1965a06.slice/crio-6c91c88044870272e439006b7f1084ec3d0bd122e57c5c697a2edb5005f831cd WatchSource:0}: Error finding container 6c91c88044870272e439006b7f1084ec3d0bd122e57c5c697a2edb5005f831cd: Status 404 returned error can't find the container with id 6c91c88044870272e439006b7f1084ec3d0bd122e57c5c697a2edb5005f831cd
Jul 31 21:36:50.136175 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:36:50.136099    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26c839e_e9b1_4a26_98ba_3a55239e7e96.slice/crio-c2fc4efeb05be3ee645bfeaebe183b94139dcfdf09f151445ad6d14f4104bfa4 WatchSource:0}: Error finding container c2fc4efeb05be3ee645bfeaebe183b94139dcfdf09f151445ad6d14f4104bfa4: Status 404 returned error can't find the container with id c2fc4efeb05be3ee645bfeaebe183b94139dcfdf09f151445ad6d14f4104bfa4
Jul 31 21:36:50.288637 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.288616    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z29n6_e26873ec-3dc3-4972-9966-c7ab244be462/dns-node-resolver/0.log"
Jul 31 21:36:50.480716 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.480654    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:36:50.480716 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.480665    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:36:50.480716 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.480654    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:36:50.483892 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.483875    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 21:36:50.484020 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.484006    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2r85f\""
Jul 31 21:36:50.484113 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.484099    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 21:36:50.484291 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.484278    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 21:36:50.484375 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.484311    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 21:36:50.484525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.484510    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl4n\""
Jul 31 21:36:50.778700 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.778617    2557 generic.go:356] "Generic (PLEG): container finished" podID="063389fa-2772-4bfc-b51a-1d25255c9a16" containerID="4cae72963702eaa6238fd625653524d93dc659ff039a5add08def88184e3a9c4" exitCode=0
Jul 31 21:36:50.778855 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.778782    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerDied","Data":"4cae72963702eaa6238fd625653524d93dc659ff039a5add08def88184e3a9c4"}
Jul 31 21:36:50.780681 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.780646    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w" event={"ID":"49b23752-232d-4f14-9109-30bcb1965a06","Type":"ContainerStarted","Data":"6c91c88044870272e439006b7f1084ec3d0bd122e57c5c697a2edb5005f831cd"}
Jul 31 21:36:50.781883 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:50.781850    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v9phl" event={"ID":"d26c839e-e9b1-4a26-98ba-3a55239e7e96","Type":"ContainerStarted","Data":"c2fc4efeb05be3ee645bfeaebe183b94139dcfdf09f151445ad6d14f4104bfa4"}
Jul 31 21:36:51.062882 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.062609    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ntbwp_8e7010c1-229b-46d3-85f2-ce1e92ab2d46/node-ca/0.log"
Jul 31 21:36:51.130435 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.130406    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:51.130588 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.130485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:51.130588 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.130513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:51.130588 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:51.130582    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:51.130732 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:51.130648    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:51.130732 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:51.130667    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:53.130644496 +0000 UTC m=+39.213653291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:51.130732 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:51.130703    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls podName:3450f80f-b1df-4fd3-b807-784ac3cbcdd1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:53.13068628 +0000 UTC m=+39.213695070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls") pod "dns-default-rt8z4" (UID: "3450f80f-b1df-4fd3-b807-784ac3cbcdd1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:51.131278 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.131251    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ead0a0c8-0dbb-4679-82b4-f09325572918-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:51.789334 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.789297    2557 generic.go:356] "Generic (PLEG): container finished" podID="063389fa-2772-4bfc-b51a-1d25255c9a16" containerID="1c9d722fced31b55c32a9823b5346f06990ce2820bd333e9b3ad058f65a46cd8" exitCode=0
Jul 31 21:36:51.789755 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:51.789363    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerDied","Data":"1c9d722fced31b55c32a9823b5346f06990ce2820bd333e9b3ad058f65a46cd8"}
Jul 31 21:36:53.146340 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.146266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:53.146340 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.146333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:53.147045 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:53.146422    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:53.147045 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:53.146476    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls podName:3450f80f-b1df-4fd3-b807-784ac3cbcdd1 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:57.146462291 +0000 UTC m=+43.229471075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls") pod "dns-default-rt8z4" (UID: "3450f80f-b1df-4fd3-b807-784ac3cbcdd1") : secret "dns-default-metrics-tls" not found
Jul 31 21:36:53.147045 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:53.146495    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:53.147045 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:53.146557    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:36:57.146539576 +0000 UTC m=+43.229548361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:53.798026 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.797988    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" event={"ID":"063389fa-2772-4bfc-b51a-1d25255c9a16","Type":"ContainerStarted","Data":"da97e6f4a9b1ebaffc1aecad42e6814ef9aa176fbee04e69e1a4b65f8b60e217"}
Jul 31 21:36:53.799452 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.799426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w" event={"ID":"49b23752-232d-4f14-9109-30bcb1965a06","Type":"ContainerStarted","Data":"eaa84e806bc9faad73fc0da371bc3fff0f4594568facd884f2ea153585163b3c"}
Jul 31 21:36:53.800751 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.800730    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v9phl" event={"ID":"d26c839e-e9b1-4a26-98ba-3a55239e7e96","Type":"ContainerStarted","Data":"3766df05ec5dca3ff0d42274c9af638a60dad95be74fe94210b0e9839357b633"}
Jul 31 21:36:53.825433 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.825387    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5dtwt" podStartSLOduration=9.532394845 podStartE2EDuration="38.825371328s" totalImagesPullingTime="29.292976483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:53.823891348 +0000 UTC m=+39.906900153" watchObservedRunningTime="2026-07-31 21:36:53.825371328 +0000 UTC m=+39.908380141"
Jul 31 21:36:53.842090 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.842055    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-mbq7w" podStartSLOduration=2.158240867 podStartE2EDuration="4.842043373s" totalImagesPullingTime="2.683802506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:53.841881829 +0000 UTC m=+39.924890633" watchObservedRunningTime="2026-07-31 21:36:53.842043373 +0000 UTC m=+39.925052173"
Jul 31 21:36:53.857219 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:53.857189    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v9phl" podStartSLOduration=2.168449589 podStartE2EDuration="4.857177646s" totalImagesPullingTime="2.688728057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:53.856547483 +0000 UTC m=+39.939556283" watchObservedRunningTime="2026-07-31 21:36:53.857177646 +0000 UTC m=+39.940186441"
Jul 31 21:36:57.175402 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:57.175372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:36:57.175799 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:36:57.175423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:36:57.175799 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:57.175508    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:57.175799 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:57.175520    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 21:36:57.175799 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:57.175555    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls podName:ead0a0c8-0dbb-4679-82b4-f09325572918 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:05.175541633 +0000 UTC m=+51.258550415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dkgq2" (UID: "ead0a0c8-0dbb-4679-82b4-f09325572918") : secret "insights-runtime-extractor-tls" not found
Jul 31 21:36:57.175799 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:36:57.175577    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls podName:3450f80f-b1df-4fd3-b807-784ac3cbcdd1 nodeName:}" failed. No retries permitted until 2026-07-31 21:37:05.175561211 +0000 UTC m=+51.258570007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls") pod "dns-default-rt8z4" (UID: "3450f80f-b1df-4fd3-b807-784ac3cbcdd1") : secret "dns-default-metrics-tls" not found
Jul 31 21:37:05.229088 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.229047    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:37:05.229528 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.229119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:37:05.232559 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.232527    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3450f80f-b1df-4fd3-b807-784ac3cbcdd1-metrics-tls\") pod \"dns-default-rt8z4\" (UID: \"3450f80f-b1df-4fd3-b807-784ac3cbcdd1\") " pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:37:05.232559 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.232541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ead0a0c8-0dbb-4679-82b4-f09325572918-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkgq2\" (UID: \"ead0a0c8-0dbb-4679-82b4-f09325572918\") " pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:37:05.265639 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.265617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dkgq2"
Jul 31 21:37:05.295089 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.295068    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:37:05.395908 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.395883    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dkgq2"]
Jul 31 21:37:05.399801 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:05.399777    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead0a0c8_0dbb_4679_82b4_f09325572918.slice/crio-2d7c656c6c4c60d76c14cb21f91361a6197abedd8741514c0551acfb66a341be WatchSource:0}: Error finding container 2d7c656c6c4c60d76c14cb21f91361a6197abedd8741514c0551acfb66a341be: Status 404 returned error can't find the container with id 2d7c656c6c4c60d76c14cb21f91361a6197abedd8741514c0551acfb66a341be
Jul 31 21:37:05.434808 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.434783    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rt8z4"]
Jul 31 21:37:05.456064 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:05.456032    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3450f80f_b1df_4fd3_b807_784ac3cbcdd1.slice/crio-9de8e71cc9423a9b51cb018a3a39b472200a552e60520f7c4d35ffd59c240c64 WatchSource:0}: Error finding container 9de8e71cc9423a9b51cb018a3a39b472200a552e60520f7c4d35ffd59c240c64: Status 404 returned error can't find the container with id 9de8e71cc9423a9b51cb018a3a39b472200a552e60520f7c4d35ffd59c240c64
Jul 31 21:37:05.828997 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.828931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rt8z4" event={"ID":"3450f80f-b1df-4fd3-b807-784ac3cbcdd1","Type":"ContainerStarted","Data":"9de8e71cc9423a9b51cb018a3a39b472200a552e60520f7c4d35ffd59c240c64"}
Jul 31 21:37:05.830117 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.830098    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkgq2" event={"ID":"ead0a0c8-0dbb-4679-82b4-f09325572918","Type":"ContainerStarted","Data":"1a07a2d8c370da93c9f1551333bedf9ed5bcfad4cce2761b2c78860a6afc0c60"}
Jul 31 21:37:05.830199 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:05.830136    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkgq2" event={"ID":"ead0a0c8-0dbb-4679-82b4-f09325572918","Type":"ContainerStarted","Data":"2d7c656c6c4c60d76c14cb21f91361a6197abedd8741514c0551acfb66a341be"}
Jul 31 21:37:06.835499 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:06.835461    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkgq2" event={"ID":"ead0a0c8-0dbb-4679-82b4-f09325572918","Type":"ContainerStarted","Data":"3e71a3d783dc6c1a139fb44fadc961f6549ad419ee4f4d5b0f74a7b7338e69a2"}
Jul 31 21:37:07.840758 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:07.840722    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rt8z4" event={"ID":"3450f80f-b1df-4fd3-b807-784ac3cbcdd1","Type":"ContainerStarted","Data":"15621f32d3f097236ed03fd51181990429a1d2e59ac4e2fcfe39eef4edf2a56a"}
Jul 31 21:37:07.841187 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:07.840784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rt8z4" event={"ID":"3450f80f-b1df-4fd3-b807-784ac3cbcdd1","Type":"ContainerStarted","Data":"34c45f03d96632065a596b93c1671f06b2775341981640a616332e7cb978ed13"}
Jul 31 21:37:07.841187 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:07.840875    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:37:07.859735 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:07.859687    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rt8z4" podStartSLOduration=16.84361886 podStartE2EDuration="18.859674299s" totalImagesPullingTime="2.016055439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:07.859174774 +0000 UTC m=+53.942183582" watchObservedRunningTime="2026-07-31 21:37:07.859674299 +0000 UTC m=+53.942683101"
Jul 31 21:37:08.845840 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:08.845805    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkgq2" event={"ID":"ead0a0c8-0dbb-4679-82b4-f09325572918","Type":"ContainerStarted","Data":"331530ccb3374a241b0e197723e0866bfe8e4c53e9b158a39136c4b99def144c"}
Jul 31 21:37:08.868494 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:08.868449    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dkgq2" podStartSLOduration=17.32620485 podStartE2EDuration="19.868434897s" totalImagesPullingTime="2.542230047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:08.866795891 +0000 UTC m=+54.949804715" watchObservedRunningTime="2026-07-31 21:37:08.868434897 +0000 UTC m=+54.951443701"
Jul 31 21:37:10.392875 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.392843    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"]
Jul 31 21:37:10.394913 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.394892    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"]
Jul 31 21:37:10.395066 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.395020    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.397134 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.397117    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"]
Jul 31 21:37:10.397262 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.397245    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.398166 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.398139    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mcm92\""
Jul 31 21:37:10.398237 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.398190    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 31 21:37:10.398809 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.398792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.402029 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.401821    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 31 21:37:10.402029 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.401900    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 31 21:37:10.402029 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.401905    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 31 21:37:10.402029 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.401914    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 31 21:37:10.402245 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.402064    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 31 21:37:10.402867 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.402853    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 31 21:37:10.404461 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.404446    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 31 21:37:10.404727 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.404709    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 31 21:37:10.404776 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.404720    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 31 21:37:10.409983 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.409941    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"]
Jul 31 21:37:10.410981 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.410943    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"]
Jul 31 21:37:10.415986 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.415950    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"]
Jul 31 21:37:10.466260 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb172d9-c0b7-4465-98ef-c61c1d45490e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.466346 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466269    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.466346 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056ca5da-db6a-4896-899a-a467579b23c5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xszjk\" (UID: \"056ca5da-db6a-4896-899a-a467579b23c5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.466416 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-ca\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.466447 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlcjx\" (UniqueName: \"kubernetes.io/projected/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-kube-api-access-rlcjx\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.466447 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/056ca5da-db6a-4896-899a-a467579b23c5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-xszjk\" (UID: \"056ca5da-db6a-4896-899a-a467579b23c5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.466513 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.466513 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.466571 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-hub\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.466571 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nj5c\" (UniqueName: \"kubernetes.io/projected/0cb172d9-c0b7-4465-98ef-c61c1d45490e-kube-api-access-8nj5c\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.466571 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.466555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-tmp\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.566982 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.566949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlcjx\" (UniqueName: \"kubernetes.io/projected/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-kube-api-access-rlcjx\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.567162 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.566990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/056ca5da-db6a-4896-899a-a467579b23c5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-xszjk\" (UID: \"056ca5da-db6a-4896-899a-a467579b23c5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.567162 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.567162 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567126    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.567372 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-hub\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.567372 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nj5c\" (UniqueName: \"kubernetes.io/projected/0cb172d9-c0b7-4465-98ef-c61c1d45490e-kube-api-access-8nj5c\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.567372 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-tmp\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.567372 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb172d9-c0b7-4465-98ef-c61c1d45490e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.567372 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567323    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.567372 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567361    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056ca5da-db6a-4896-899a-a467579b23c5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xszjk\" (UID: \"056ca5da-db6a-4896-899a-a467579b23c5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.567666 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-ca\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.567666 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.567563    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-tmp\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.568079 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.568033    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb172d9-c0b7-4465-98ef-c61c1d45490e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.568603 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.568567    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/056ca5da-db6a-4896-899a-a467579b23c5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-xszjk\" (UID: \"056ca5da-db6a-4896-899a-a467579b23c5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.569893 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.569871    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-hub\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.569999 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.569984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-klusterlet-config\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.570099 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.570079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-ca\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.570160 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.570110    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.570322 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.570302    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0cb172d9-c0b7-4465-98ef-c61c1d45490e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.570407 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.570393    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/056ca5da-db6a-4896-899a-a467579b23c5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-xszjk\" (UID: \"056ca5da-db6a-4896-899a-a467579b23c5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.592886 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.592859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nj5c\" (UniqueName: \"kubernetes.io/projected/0cb172d9-c0b7-4465-98ef-c61c1d45490e-kube-api-access-8nj5c\") pod \"cluster-proxy-proxy-agent-f956b8cd4-rwh2v\" (UID: \"0cb172d9-c0b7-4465-98ef-c61c1d45490e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.599185 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.599162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlcjx\" (UniqueName: \"kubernetes.io/projected/9d7e0cfe-dd6a-422f-9f68-5d20478e0265-kube-api-access-rlcjx\") pod \"klusterlet-addon-workmgr-9c6cb894f-rqnzs\" (UID: \"9d7e0cfe-dd6a-422f-9f68-5d20478e0265\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.705407 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.705341    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"
Jul 31 21:37:10.712509 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.712488    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:10.725460 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.725435    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"
Jul 31 21:37:10.866928 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.866897    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-xszjk"]
Jul 31 21:37:10.870006 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:10.869979    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056ca5da_db6a_4896_899a_a467579b23c5.slice/crio-6996684d19c87a93dd7b627e830fc77db0a0a326aa6e4c5130e6f1c4fb949677 WatchSource:0}: Error finding container 6996684d19c87a93dd7b627e830fc77db0a0a326aa6e4c5130e6f1c4fb949677: Status 404 returned error can't find the container with id 6996684d19c87a93dd7b627e830fc77db0a0a326aa6e4c5130e6f1c4fb949677
Jul 31 21:37:10.908072 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:10.908049    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7e0cfe_dd6a_422f_9f68_5d20478e0265.slice/crio-e8df2256d001c51847047894b9b0e25fbfa479640a05662737d06b5a61ae0195 WatchSource:0}: Error finding container e8df2256d001c51847047894b9b0e25fbfa479640a05662737d06b5a61ae0195: Status 404 returned error can't find the container with id e8df2256d001c51847047894b9b0e25fbfa479640a05662737d06b5a61ae0195
Jul 31 21:37:10.911675 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.911657    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"]
Jul 31 21:37:10.912358 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:10.912317    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v"]
Jul 31 21:37:10.914121 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:10.914102    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cb172d9_c0b7_4465_98ef_c61c1d45490e.slice/crio-1765e63447db3cdbd9b658fb64a574d5ab6afcee0f4dcbc103ec3168d6327031 WatchSource:0}: Error finding container 1765e63447db3cdbd9b658fb64a574d5ab6afcee0f4dcbc103ec3168d6327031: Status 404 returned error can't find the container with id 1765e63447db3cdbd9b658fb64a574d5ab6afcee0f4dcbc103ec3168d6327031
Jul 31 21:37:11.858715 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:11.858676    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk" event={"ID":"056ca5da-db6a-4896-899a-a467579b23c5","Type":"ContainerStarted","Data":"6996684d19c87a93dd7b627e830fc77db0a0a326aa6e4c5130e6f1c4fb949677"}
Jul 31 21:37:11.860155 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:11.860089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v" event={"ID":"0cb172d9-c0b7-4465-98ef-c61c1d45490e","Type":"ContainerStarted","Data":"1765e63447db3cdbd9b658fb64a574d5ab6afcee0f4dcbc103ec3168d6327031"}
Jul 31 21:37:11.862467 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:11.862405    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs" event={"ID":"9d7e0cfe-dd6a-422f-9f68-5d20478e0265","Type":"ContainerStarted","Data":"e8df2256d001c51847047894b9b0e25fbfa479640a05662737d06b5a61ae0195"}
Jul 31 21:37:12.867700 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:12.867659    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk" event={"ID":"056ca5da-db6a-4896-899a-a467579b23c5","Type":"ContainerStarted","Data":"67d6874259aa5c76e10a648a6991631be1ca041aee04ad338b12b727e7c129f3"}
Jul 31 21:37:12.884665 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:12.884605    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-xszjk" podStartSLOduration=1.580351189 podStartE2EDuration="2.88458668s" totalImagesPullingTime="1.304235491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:12.882413534 +0000 UTC m=+58.965422340" watchObservedRunningTime="2026-07-31 21:37:12.88458668 +0000 UTC m=+58.967595486"
Jul 31 21:37:14.777722 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:14.777692    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgcgb"
Jul 31 21:37:16.882497 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:16.882461    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v" event={"ID":"0cb172d9-c0b7-4465-98ef-c61c1d45490e","Type":"ContainerStarted","Data":"62396602e70fae8ddbdf2d2bdd773e36e643774bb38588d301650f53afac321d"}
Jul 31 21:37:16.882924 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:16.882510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v" event={"ID":"0cb172d9-c0b7-4465-98ef-c61c1d45490e","Type":"ContainerStarted","Data":"b1a2010d66a56355601432f822c8cc1f13f731f79390fd51e1dd799db3fd3ddd"}
Jul 31 21:37:16.883924 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:16.883885    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs" event={"ID":"9d7e0cfe-dd6a-422f-9f68-5d20478e0265","Type":"ContainerStarted","Data":"3f6c512e87422f341cf4ccb5938afe725907f8d70e8305b8bc44393a3304c4a2"}
Jul 31 21:37:16.884243 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:16.884189    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:16.885700 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:16.885678    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs"
Jul 31 21:37:16.905537 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:16.905486    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9c6cb894f-rqnzs" podStartSLOduration=1.06092113 podStartE2EDuration="6.905464895s" totalImagesPullingTime="5.844543765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:16.90348532 +0000 UTC m=+62.986494126" watchObservedRunningTime="2026-07-31 21:37:16.905464895 +0000 UTC m=+62.988473701"
Jul 31 21:37:17.847967 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:17.847924    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rt8z4"
Jul 31 21:37:17.889586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:17.889550    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v" event={"ID":"0cb172d9-c0b7-4465-98ef-c61c1d45490e","Type":"ContainerStarted","Data":"a1145c595548367319e8bea51619976d8228aaf92df7871ef4b8603eec26ae23"}
Jul 31 21:37:17.910783 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:17.910739    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f956b8cd4-rwh2v" podStartSLOduration=2.080470118 podStartE2EDuration="7.910723273s" totalImagesPullingTime="5.830253155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:17.910253931 +0000 UTC m=+63.993262737" watchObservedRunningTime="2026-07-31 21:37:17.910723273 +0000 UTC m=+63.993732078"
Jul 31 21:37:20.250358 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.250320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:37:20.250358 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.250368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:37:20.253589 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.253570    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 21:37:20.253677 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.253659    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 21:37:20.263100 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.263069    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9102a20-c095-41e5-9cce-5112fd032423-metrics-certs\") pod \"network-metrics-daemon-qnwl6\" (UID: \"c9102a20-c095-41e5-9cce-5112fd032423\") " pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:37:20.263225 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.263181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83b91889-0841-4386-bef9-29bf74a33547-original-pull-secret\") pod \"global-pull-secret-syncer-kv9ct\" (UID: \"83b91889-0841-4386-bef9-29bf74a33547\") " pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:37:20.351442 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.351405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:37:20.354317 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.354301    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 21:37:20.364772 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.364755    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 21:37:20.375242 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.375218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dm62\" (UniqueName: \"kubernetes.io/projected/b7ccf582-7e2c-4cba-8018-196b525e3ca0-kube-api-access-6dm62\") pod \"network-check-target-5cv2k\" (UID: \"b7ccf582-7e2c-4cba-8018-196b525e3ca0\") " pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:37:20.492766 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.492737    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl4n\""
Jul 31 21:37:20.496211 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.496194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv9ct"
Jul 31 21:37:20.500332 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.500317    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnwl6"
Jul 31 21:37:20.503442 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.503403    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2r85f\""
Jul 31 21:37:20.511025 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.511007    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:37:20.668264 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.668208    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kv9ct"]
Jul 31 21:37:20.671027 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:20.670990    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b91889_0841_4386_bef9_29bf74a33547.slice/crio-5aabfd4ab84e7423a9cd57aef89a17d7b549f87192d5412f2bfc1c72c6cf98d1 WatchSource:0}: Error finding container 5aabfd4ab84e7423a9cd57aef89a17d7b549f87192d5412f2bfc1c72c6cf98d1: Status 404 returned error can't find the container with id 5aabfd4ab84e7423a9cd57aef89a17d7b549f87192d5412f2bfc1c72c6cf98d1
Jul 31 21:37:20.694305 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.694278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qnwl6"]
Jul 31 21:37:20.696967 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:20.696923    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9102a20_c095_41e5_9cce_5112fd032423.slice/crio-c6d1abf0ad9411a29d6eed3a98ef3baa18091d2a70c27023c41164667d8e4879 WatchSource:0}: Error finding container c6d1abf0ad9411a29d6eed3a98ef3baa18091d2a70c27023c41164667d8e4879: Status 404 returned error can't find the container with id c6d1abf0ad9411a29d6eed3a98ef3baa18091d2a70c27023c41164667d8e4879
Jul 31 21:37:20.710634 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.710612    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5cv2k"]
Jul 31 21:37:20.712156 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:20.712135    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ccf582_7e2c_4cba_8018_196b525e3ca0.slice/crio-4248a3e2fb6a20abdaa395ab599a7d109cd6f78f0c7fcc606f2310664024a618 WatchSource:0}: Error finding container 4248a3e2fb6a20abdaa395ab599a7d109cd6f78f0c7fcc606f2310664024a618: Status 404 returned error can't find the container with id 4248a3e2fb6a20abdaa395ab599a7d109cd6f78f0c7fcc606f2310664024a618
Jul 31 21:37:20.900850 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.900763    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnwl6" event={"ID":"c9102a20-c095-41e5-9cce-5112fd032423","Type":"ContainerStarted","Data":"c6d1abf0ad9411a29d6eed3a98ef3baa18091d2a70c27023c41164667d8e4879"}
Jul 31 21:37:20.901919 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.901887    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5cv2k" event={"ID":"b7ccf582-7e2c-4cba-8018-196b525e3ca0","Type":"ContainerStarted","Data":"4248a3e2fb6a20abdaa395ab599a7d109cd6f78f0c7fcc606f2310664024a618"}
Jul 31 21:37:20.902944 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:20.902923    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kv9ct" event={"ID":"83b91889-0841-4386-bef9-29bf74a33547","Type":"ContainerStarted","Data":"5aabfd4ab84e7423a9cd57aef89a17d7b549f87192d5412f2bfc1c72c6cf98d1"}
Jul 31 21:37:22.914618 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.914529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnwl6" event={"ID":"c9102a20-c095-41e5-9cce-5112fd032423","Type":"ContainerStarted","Data":"08b62bee3eef18e317b0fe3969551a50dddf3c128bc77d0ed9bbc0abffb7c3f8"}
Jul 31 21:37:22.914618 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.914591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnwl6" event={"ID":"c9102a20-c095-41e5-9cce-5112fd032423","Type":"ContainerStarted","Data":"daf9c3d457aa28262fbf6645f1d9d0ce22919cbe8d0e1d524695b45748d06fce"}
Jul 31 21:37:22.931536 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.931502    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rqvr7"]
Jul 31 21:37:22.941804 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.941745    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qnwl6" podStartSLOduration=66.297757408 podStartE2EDuration="1m7.941722198s" totalImagesPullingTime="1.64396479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:22.940371082 +0000 UTC m=+69.023379888" watchObservedRunningTime="2026-07-31 21:37:22.941722198 +0000 UTC m=+69.024731004"
Jul 31 21:37:22.956301 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.956267    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:22.959711 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.959592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 21:37:22.960662 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.960382    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 21:37:22.960662 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.960397    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6wjct\""
Jul 31 21:37:22.960662 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.960397    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 21:37:22.960662 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.960498    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 21:37:22.960662 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.960619    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 21:37:22.961015 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:22.960848    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 21:37:23.073550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57804dd6-670e-43b6-87e1-4c7955b9ab93-metrics-client-ca\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.073743 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.073743 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7x9p\" (UniqueName: \"kubernetes.io/projected/57804dd6-670e-43b6-87e1-4c7955b9ab93-kube-api-access-q7x9p\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.073743 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073635    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-textfile\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.073743 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073677    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-root\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.073743 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-wtmp\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.074036 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073744    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-tls\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.074036 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073785    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.074036 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.073810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-sys\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57804dd6-670e-43b6-87e1-4c7955b9ab93-metrics-client-ca\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7x9p\" (UniqueName: \"kubernetes.io/projected/57804dd6-670e-43b6-87e1-4c7955b9ab93-kube-api-access-q7x9p\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-textfile\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175353    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-root\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-wtmp\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175414    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-tls\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-sys\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175563    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-sys\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.175928    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-accelerators-collector-config\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.176099    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-textfile\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.176225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-wtmp\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.176416    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/57804dd6-670e-43b6-87e1-4c7955b9ab93-root\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.176752 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.176645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57804dd6-670e-43b6-87e1-4c7955b9ab93-metrics-client-ca\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.179226 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.179179    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-tls\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.180418 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.180376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57804dd6-670e-43b6-87e1-4c7955b9ab93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.185876 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.185820    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7x9p\" (UniqueName: \"kubernetes.io/projected/57804dd6-670e-43b6-87e1-4c7955b9ab93-kube-api-access-q7x9p\") pod \"node-exporter-rqvr7\" (UID: \"57804dd6-670e-43b6-87e1-4c7955b9ab93\") " pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:23.270341 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:23.270296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rqvr7"
Jul 31 21:37:25.517919 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:37:25.517891    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57804dd6_670e_43b6_87e1_4c7955b9ab93.slice/crio-1103a150057f9d46e321f6d86bed51edc9f3f18eb1d49b31802aa8c73f2610d0 WatchSource:0}: Error finding container 1103a150057f9d46e321f6d86bed51edc9f3f18eb1d49b31802aa8c73f2610d0: Status 404 returned error can't find the container with id 1103a150057f9d46e321f6d86bed51edc9f3f18eb1d49b31802aa8c73f2610d0
Jul 31 21:37:25.929535 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:25.929436    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5cv2k" event={"ID":"b7ccf582-7e2c-4cba-8018-196b525e3ca0","Type":"ContainerStarted","Data":"3e586f17eeb8f8905d5315e2733bb92189d48d5b4baabdb884f14510d5c25a13"}
Jul 31 21:37:25.929702 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:25.929556    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:37:25.930951 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:25.930933    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kv9ct" event={"ID":"83b91889-0841-4386-bef9-29bf74a33547","Type":"ContainerStarted","Data":"4eaafd7e8cde1fb750f8a4c96f4502de8b8fae6932db8c77eaca6c4db7c7a688"}
Jul 31 21:37:25.932081 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:25.932059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqvr7" event={"ID":"57804dd6-670e-43b6-87e1-4c7955b9ab93","Type":"ContainerStarted","Data":"1103a150057f9d46e321f6d86bed51edc9f3f18eb1d49b31802aa8c73f2610d0"}
Jul 31 21:37:25.945748 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:25.945709    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5cv2k" podStartSLOduration=66.132238123 podStartE2EDuration="1m10.945696545s" totalImagesPullingTime="4.813458422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:25.945268513 +0000 UTC m=+72.028277319" watchObservedRunningTime="2026-07-31 21:37:25.945696545 +0000 UTC m=+72.028705350"
Jul 31 21:37:25.965206 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:25.962553    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kv9ct" podStartSLOduration=66.103633038 podStartE2EDuration="1m10.962533763s" totalImagesPullingTime="4.858900725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:25.960810475 +0000 UTC m=+72.043819284" watchObservedRunningTime="2026-07-31 21:37:25.962533763 +0000 UTC m=+72.045542571"
Jul 31 21:37:26.937226 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:26.937133    2557 generic.go:356] "Generic (PLEG): container finished" podID="57804dd6-670e-43b6-87e1-4c7955b9ab93" containerID="20c6a8bf7ce3421cb93b3da7156e39c3f9c766004b876b566198eb092a2e1180" exitCode=0
Jul 31 21:37:26.937604 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:26.937223    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqvr7" event={"ID":"57804dd6-670e-43b6-87e1-4c7955b9ab93","Type":"ContainerDied","Data":"20c6a8bf7ce3421cb93b3da7156e39c3f9c766004b876b566198eb092a2e1180"}
Jul 31 21:37:27.945313 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:27.945277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqvr7" event={"ID":"57804dd6-670e-43b6-87e1-4c7955b9ab93","Type":"ContainerStarted","Data":"4ae7b258ff9228c18681e7567a2a874749ef7da0a5f507990e8c4a873262bcb5"}
Jul 31 21:37:27.945761 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:27.945340    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rqvr7" event={"ID":"57804dd6-670e-43b6-87e1-4c7955b9ab93","Type":"ContainerStarted","Data":"d66a132e9401fd042a6d4ba73fb701771bdee471f1c35bd8b1e79bc5dd619859"}
Jul 31 21:37:27.968567 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:27.968522    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rqvr7" podStartSLOduration=4.890206845 podStartE2EDuration="5.968508372s" totalImagesPullingTime="1.015101718s" totalInitContainerRuntime="63.199809ms" isStatefulPod=true podCreationTimestamp="2026-07-31 21:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:27.967248216 +0000 UTC m=+74.050257023" watchObservedRunningTime="2026-07-31 21:37:27.968508372 +0000 UTC m=+74.051517178"
Jul 31 21:37:56.939400 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:37:56.939362    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5cv2k"
Jul 31 21:41:14.334545 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:14.334516    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:41:14.337262 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:14.337242    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 21:41:14.339353 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:14.339336    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:41:19.613392 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.613362    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"]
Jul 31 21:41:19.615166 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.615150    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.618201 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.618177    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:41:19.618294 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.618180    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hxw2t\""
Jul 31 21:41:19.619030 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.619016    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 31 21:41:19.634525 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.634504    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"]
Jul 31 21:41:19.724287 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.724258    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeff99b3-c196-46dc-9fca-c1d168d8b61b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pm2l2\" (UID: \"aeff99b3-c196-46dc-9fca-c1d168d8b61b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.724409 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.724291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5xc\" (UniqueName: \"kubernetes.io/projected/aeff99b3-c196-46dc-9fca-c1d168d8b61b-kube-api-access-bj5xc\") pod \"cert-manager-operator-controller-manager-55c444bf86-pm2l2\" (UID: \"aeff99b3-c196-46dc-9fca-c1d168d8b61b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.824997 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.824947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeff99b3-c196-46dc-9fca-c1d168d8b61b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pm2l2\" (UID: \"aeff99b3-c196-46dc-9fca-c1d168d8b61b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.824997 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.825004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5xc\" (UniqueName: \"kubernetes.io/projected/aeff99b3-c196-46dc-9fca-c1d168d8b61b-kube-api-access-bj5xc\") pod \"cert-manager-operator-controller-manager-55c444bf86-pm2l2\" (UID: \"aeff99b3-c196-46dc-9fca-c1d168d8b61b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.825298 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.825281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aeff99b3-c196-46dc-9fca-c1d168d8b61b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pm2l2\" (UID: \"aeff99b3-c196-46dc-9fca-c1d168d8b61b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.833594 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.833576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5xc\" (UniqueName: \"kubernetes.io/projected/aeff99b3-c196-46dc-9fca-c1d168d8b61b-kube-api-access-bj5xc\") pod \"cert-manager-operator-controller-manager-55c444bf86-pm2l2\" (UID: \"aeff99b3-c196-46dc-9fca-c1d168d8b61b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:19.923514 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:19.923461    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"
Jul 31 21:41:20.050003 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:20.049974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2"]
Jul 31 21:41:20.054226 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:41:20.054196    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeff99b3_c196_46dc_9fca_c1d168d8b61b.slice/crio-8c15adb49231996b51035d66253044f7adfdf7fea39fcbdbcea3d924cd654825 WatchSource:0}: Error finding container 8c15adb49231996b51035d66253044f7adfdf7fea39fcbdbcea3d924cd654825: Status 404 returned error can't find the container with id 8c15adb49231996b51035d66253044f7adfdf7fea39fcbdbcea3d924cd654825
Jul 31 21:41:20.056816 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:20.056798    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:41:20.686534 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:20.686496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2" event={"ID":"aeff99b3-c196-46dc-9fca-c1d168d8b61b","Type":"ContainerStarted","Data":"8c15adb49231996b51035d66253044f7adfdf7fea39fcbdbcea3d924cd654825"}
Jul 31 21:41:23.700257 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:23.700224    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2" event={"ID":"aeff99b3-c196-46dc-9fca-c1d168d8b61b","Type":"ContainerStarted","Data":"e2aa6ad4b7ed6375a9c388eb1ed70cc2fbe091d3cf383148fb8e9f77831f2411"}
Jul 31 21:41:23.728051 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:23.727997    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pm2l2" podStartSLOduration=2.019747672 podStartE2EDuration="4.727982546s" totalImagesPullingTime="2.708234874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:41:23.725896963 +0000 UTC m=+309.808905767" watchObservedRunningTime="2026-07-31 21:41:23.727982546 +0000 UTC m=+309.810991352"
Jul 31 21:41:26.687214 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.687175    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"]
Jul 31 21:41:26.690203 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.690188    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.692951 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.692922    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nxsjg\""
Jul 31 21:41:26.694284 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.694259    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 31 21:41:26.694406 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.694300    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 31 21:41:26.699472 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.699454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"]
Jul 31 21:41:26.771051 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.771025    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55d4a606-2794-4ec8-9970-a8f78b8a03bb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sg4pf\" (UID: \"55d4a606-2794-4ec8-9970-a8f78b8a03bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.771157 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.771066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgjcg\" (UniqueName: \"kubernetes.io/projected/55d4a606-2794-4ec8-9970-a8f78b8a03bb-kube-api-access-vgjcg\") pod \"cert-manager-cainjector-559cdd8c87-sg4pf\" (UID: \"55d4a606-2794-4ec8-9970-a8f78b8a03bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.872029 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.871993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55d4a606-2794-4ec8-9970-a8f78b8a03bb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sg4pf\" (UID: \"55d4a606-2794-4ec8-9970-a8f78b8a03bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.872163 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.872046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgjcg\" (UniqueName: \"kubernetes.io/projected/55d4a606-2794-4ec8-9970-a8f78b8a03bb-kube-api-access-vgjcg\") pod \"cert-manager-cainjector-559cdd8c87-sg4pf\" (UID: \"55d4a606-2794-4ec8-9970-a8f78b8a03bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.881390 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.881360    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgjcg\" (UniqueName: \"kubernetes.io/projected/55d4a606-2794-4ec8-9970-a8f78b8a03bb-kube-api-access-vgjcg\") pod \"cert-manager-cainjector-559cdd8c87-sg4pf\" (UID: \"55d4a606-2794-4ec8-9970-a8f78b8a03bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.881483 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.881412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/55d4a606-2794-4ec8-9970-a8f78b8a03bb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sg4pf\" (UID: \"55d4a606-2794-4ec8-9970-a8f78b8a03bb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:26.999305 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:26.999283    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"
Jul 31 21:41:27.135090 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:27.135066    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf"]
Jul 31 21:41:27.136929 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:41:27.136900    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55d4a606_2794_4ec8_9970_a8f78b8a03bb.slice/crio-66e95e18c2d58059292b24f9dbf89b5e9457972415dfc54da97a04b6f9575000 WatchSource:0}: Error finding container 66e95e18c2d58059292b24f9dbf89b5e9457972415dfc54da97a04b6f9575000: Status 404 returned error can't find the container with id 66e95e18c2d58059292b24f9dbf89b5e9457972415dfc54da97a04b6f9575000
Jul 31 21:41:27.715505 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:27.715472    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf" event={"ID":"55d4a606-2794-4ec8-9970-a8f78b8a03bb","Type":"ContainerStarted","Data":"66e95e18c2d58059292b24f9dbf89b5e9457972415dfc54da97a04b6f9575000"}
Jul 31 21:41:30.729004 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:30.728972    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf" event={"ID":"55d4a606-2794-4ec8-9970-a8f78b8a03bb","Type":"ContainerStarted","Data":"79f4f6ee7bac3547adb53fe8dd1007d5a21e1bd78638a438a1b7e336cfaf4897"}
Jul 31 21:41:30.759975 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:30.757578    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sg4pf" podStartSLOduration=2.074560405 podStartE2EDuration="4.757556095s" totalImagesPullingTime="2.68299569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:41:30.754414902 +0000 UTC m=+316.837423702" watchObservedRunningTime="2026-07-31 21:41:30.757556095 +0000 UTC m=+316.840564901"
Jul 31 21:41:58.140581 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.140545    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"]
Jul 31 21:41:58.144967 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.144936    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.147715 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.147697    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 21:41:58.147927 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.147833    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wpdq\""
Jul 31 21:41:58.147927 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.147901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 21:41:58.148185 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.148165    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 21:41:58.148460 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.148240    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 21:41:58.164408 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.164381    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"]
Jul 31 21:41:58.272892 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.272862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.273040 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.272901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdlt\" (UniqueName: \"kubernetes.io/projected/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-kube-api-access-2sdlt\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.273040 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.272921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-tmp\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.273166 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.273056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-manifests\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.273166 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.273092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.374251 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.374225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-tmp\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.374381 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.374266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-manifests\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.374381 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.374285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.374381 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.374311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.374541 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.374419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdlt\" (UniqueName: \"kubernetes.io/projected/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-kube-api-access-2sdlt\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.374690 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.374670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-manifests\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.376484 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.376459    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-tmp\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.376599 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.376505    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.376654 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.376603    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.384307 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.384289    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdlt\" (UniqueName: \"kubernetes.io/projected/ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff-kube-api-access-2sdlt\") pod \"opendatahub-operator-controller-manager-67685b9c4d-r7m7j\" (UID: \"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff\") " pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.455256 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.455202    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:41:58.602285 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.602256    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"]
Jul 31 21:41:58.605265 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:41:58.605241    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2b9ca8_7a4c_4ff3_ad17_0e6a69d317ff.slice/crio-2541aef300a8076c364a592d4b376cb10a1bff762d1a455b5fbf8f607c19e622 WatchSource:0}: Error finding container 2541aef300a8076c364a592d4b376cb10a1bff762d1a455b5fbf8f607c19e622: Status 404 returned error can't find the container with id 2541aef300a8076c364a592d4b376cb10a1bff762d1a455b5fbf8f607c19e622
Jul 31 21:41:58.816637 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:41:58.816608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j" event={"ID":"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff","Type":"ContainerStarted","Data":"2541aef300a8076c364a592d4b376cb10a1bff762d1a455b5fbf8f607c19e622"}
Jul 31 21:42:01.830300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:01.830264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j" event={"ID":"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff","Type":"ContainerStarted","Data":"cb2ffc09a64496bd4d7972e6ed13075ed086375f43d35f9e1f2cc5a4e3a2e584"}
Jul 31 21:42:02.836164 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:02.836123    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff" containerID="cb2ffc09a64496bd4d7972e6ed13075ed086375f43d35f9e1f2cc5a4e3a2e584" exitCode=0
Jul 31 21:42:02.836627 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:02.836207    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j" event={"ID":"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff","Type":"ContainerDied","Data":"cb2ffc09a64496bd4d7972e6ed13075ed086375f43d35f9e1f2cc5a4e3a2e584"}
Jul 31 21:42:03.842243 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:03.842206    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j" event={"ID":"ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff","Type":"ContainerStarted","Data":"509c9d404998c30b172b3152475bf7c0572a8f98b1d781568311dcd0e31cb6bd"}
Jul 31 21:42:03.842611 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:03.842290    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:42:03.876265 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:03.876200    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j" podStartSLOduration=1.69454321 podStartE2EDuration="5.87618499s" totalImagesPullingTime="3.170236216s" totalInitContainerRuntime="1.011405564s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:41:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:03.875499117 +0000 UTC m=+349.958507923" watchObservedRunningTime="2026-07-31 21:42:03.87618499 +0000 UTC m=+349.959193794"
Jul 31 21:42:14.848215 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:14.848143    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67685b9c4d-r7m7j"
Jul 31 21:42:15.581083 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.581047    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"]
Jul 31 21:42:15.587588 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.587564    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.591814 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.591789    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 21:42:15.593210 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.593189    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 21:42:15.593313 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.593209    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 21:42:15.593313 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.593237    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:42:15.593313 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.593190    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 21:42:15.593313 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.593199    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5d8wk\""
Jul 31 21:42:15.601182 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.601159    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"]
Jul 31 21:42:15.695569 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.695534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/949da123-89a5-4645-8cc4-a6598b339ba5-metrics-cert\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.695737 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.695578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949da123-89a5-4645-8cc4-a6598b339ba5-cert\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.695737 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.695600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/949da123-89a5-4645-8cc4-a6598b339ba5-manager-config\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.695737 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.695683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p4d8\" (UniqueName: \"kubernetes.io/projected/949da123-89a5-4645-8cc4-a6598b339ba5-kube-api-access-4p4d8\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.796755 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.796721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p4d8\" (UniqueName: \"kubernetes.io/projected/949da123-89a5-4645-8cc4-a6598b339ba5-kube-api-access-4p4d8\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.796913 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.796765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/949da123-89a5-4645-8cc4-a6598b339ba5-metrics-cert\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.796913 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.796793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949da123-89a5-4645-8cc4-a6598b339ba5-cert\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.796913 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.796824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/949da123-89a5-4645-8cc4-a6598b339ba5-manager-config\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.797564 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.797536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/949da123-89a5-4645-8cc4-a6598b339ba5-manager-config\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.799286 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.799259    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/949da123-89a5-4645-8cc4-a6598b339ba5-cert\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.799459 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.799436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/949da123-89a5-4645-8cc4-a6598b339ba5-metrics-cert\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.808038 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.808009    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p4d8\" (UniqueName: \"kubernetes.io/projected/949da123-89a5-4645-8cc4-a6598b339ba5-kube-api-access-4p4d8\") pod \"lws-controller-manager-6bf58c775b-gkrdm\" (UID: \"949da123-89a5-4645-8cc4-a6598b339ba5\") " pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:15.896401 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:15.896337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:16.031456 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:16.031429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"]
Jul 31 21:42:16.032883 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:42:16.032857    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949da123_89a5_4645_8cc4_a6598b339ba5.slice/crio-e346b925cb21b06e72eb5e45c4204646c6781cdc79c0a67bf31c97008c07fcdd WatchSource:0}: Error finding container e346b925cb21b06e72eb5e45c4204646c6781cdc79c0a67bf31c97008c07fcdd: Status 404 returned error can't find the container with id e346b925cb21b06e72eb5e45c4204646c6781cdc79c0a67bf31c97008c07fcdd
Jul 31 21:42:16.894310 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:16.894269    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm" event={"ID":"949da123-89a5-4645-8cc4-a6598b339ba5","Type":"ContainerStarted","Data":"e346b925cb21b06e72eb5e45c4204646c6781cdc79c0a67bf31c97008c07fcdd"}
Jul 31 21:42:18.903165 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:18.903072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm" event={"ID":"949da123-89a5-4645-8cc4-a6598b339ba5","Type":"ContainerStarted","Data":"bff377862ab1c53e555dee070446a410aec6f7c748ea1da2218da2c9f827425c"}
Jul 31 21:42:18.903517 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:18.903178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:18.942157 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:18.942116    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm" podStartSLOduration=1.452805183 podStartE2EDuration="3.942104078s" totalImagesPullingTime="2.489298895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:18.941973488 +0000 UTC m=+365.024982293" watchObservedRunningTime="2026-07-31 21:42:18.942104078 +0000 UTC m=+365.025112882"
Jul 31 21:42:29.909668 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:29.909638    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bf58c775b-gkrdm"
Jul 31 21:42:30.182313 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.182230    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"]
Jul 31 21:42:30.185937 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.185916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.189169 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.189150    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kfpmx\""
Jul 31 21:42:30.189280 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.189252    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 31 21:42:30.201661 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.201637    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"]
Jul 31 21:42:30.203237 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.203215    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"]
Jul 31 21:42:30.206528 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.206489    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.209120 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.209101    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 31 21:42:30.209553 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.209532    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s67kh\""
Jul 31 21:42:30.232533 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.232490    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"]
Jul 31 21:42:30.305401 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.305374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjvfx\" (UniqueName: \"kubernetes.io/projected/b4fd4254-c59a-4daa-ade7-91d0f97e5902-kube-api-access-wjvfx\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.305515 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.305413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4fd4254-c59a-4daa-ade7-91d0f97e5902-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.305515 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.305440    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.305515 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.305473    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjgjx\" (UniqueName: \"kubernetes.io/projected/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-kube-api-access-rjgjx\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.406419 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.406391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjvfx\" (UniqueName: \"kubernetes.io/projected/b4fd4254-c59a-4daa-ade7-91d0f97e5902-kube-api-access-wjvfx\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.406529 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.406423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4fd4254-c59a-4daa-ade7-91d0f97e5902-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.406529 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.406440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.406529 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.406466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjgjx\" (UniqueName: \"kubernetes.io/projected/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-kube-api-access-rjgjx\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.406687 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:42:30.406557    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 31 21:42:30.406687 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:42:30.406620    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4fd4254-c59a-4daa-ade7-91d0f97e5902-cert podName:b4fd4254-c59a-4daa-ade7-91d0f97e5902 nodeName:}" failed. No retries permitted until 2026-07-31 21:42:30.906599847 +0000 UTC m=+376.989608633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b4fd4254-c59a-4daa-ade7-91d0f97e5902-cert") pod "kserve-controller-manager-d6f4b65b8-8jj42" (UID: "b4fd4254-c59a-4daa-ade7-91d0f97e5902") : secret "kserve-webhook-server-cert" not found
Jul 31 21:42:30.406687 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:42:30.406558    2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 31 21:42:30.406836 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:42:30.406691    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-cert podName:7bf611f7-aa84-4ad9-82d9-e80e538f51b5 nodeName:}" failed. No retries permitted until 2026-07-31 21:42:30.906679561 +0000 UTC m=+376.989688344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-cert") pod "llmisvc-controller-manager-777c6bd7d5-6whzg" (UID: "7bf611f7-aa84-4ad9-82d9-e80e538f51b5") : secret "llmisvc-webhook-server-cert" not found
Jul 31 21:42:30.416550 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.416526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjvfx\" (UniqueName: \"kubernetes.io/projected/b4fd4254-c59a-4daa-ade7-91d0f97e5902-kube-api-access-wjvfx\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.417089 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.417070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjgjx\" (UniqueName: \"kubernetes.io/projected/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-kube-api-access-rjgjx\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.910347 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.910310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4fd4254-c59a-4daa-ade7-91d0f97e5902-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:30.910347 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.910345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.912836 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.912811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bf611f7-aa84-4ad9-82d9-e80e538f51b5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6whzg\" (UID: \"7bf611f7-aa84-4ad9-82d9-e80e538f51b5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:30.912906 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:30.912811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4fd4254-c59a-4daa-ade7-91d0f97e5902-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jj42\" (UID: \"b4fd4254-c59a-4daa-ade7-91d0f97e5902\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:31.097655 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:31.097624    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:31.118047 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:31.118024    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:31.236487 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:31.236463    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"]
Jul 31 21:42:31.238337 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:42:31.238312    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fd4254_c59a_4daa_ade7_91d0f97e5902.slice/crio-8cee9226143e2f20829777488cb35b6755d16bf2240d8a6b7858e8a3e6f9cd29 WatchSource:0}: Error finding container 8cee9226143e2f20829777488cb35b6755d16bf2240d8a6b7858e8a3e6f9cd29: Status 404 returned error can't find the container with id 8cee9226143e2f20829777488cb35b6755d16bf2240d8a6b7858e8a3e6f9cd29
Jul 31 21:42:31.265893 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:31.265873    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"]
Jul 31 21:42:31.268074 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:42:31.268049    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7bf611f7_aa84_4ad9_82d9_e80e538f51b5.slice/crio-c5275732672b39f2a6029e68301d6ee72f43384b73bd5ab51c20a076032186c3 WatchSource:0}: Error finding container c5275732672b39f2a6029e68301d6ee72f43384b73bd5ab51c20a076032186c3: Status 404 returned error can't find the container with id c5275732672b39f2a6029e68301d6ee72f43384b73bd5ab51c20a076032186c3
Jul 31 21:42:31.956900 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:31.956865    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42" event={"ID":"b4fd4254-c59a-4daa-ade7-91d0f97e5902","Type":"ContainerStarted","Data":"8cee9226143e2f20829777488cb35b6755d16bf2240d8a6b7858e8a3e6f9cd29"}
Jul 31 21:42:31.958433 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:31.958392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg" event={"ID":"7bf611f7-aa84-4ad9-82d9-e80e538f51b5","Type":"ContainerStarted","Data":"c5275732672b39f2a6029e68301d6ee72f43384b73bd5ab51c20a076032186c3"}
Jul 31 21:42:34.974086 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:34.974050    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42" event={"ID":"b4fd4254-c59a-4daa-ade7-91d0f97e5902","Type":"ContainerStarted","Data":"507a0f87abb37bd4027d3a86c05c531bd2574de595a6822098c5a3d57c2f299d"}
Jul 31 21:42:34.974520 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:34.974128    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:42:34.975497 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:34.975472    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg" event={"ID":"7bf611f7-aa84-4ad9-82d9-e80e538f51b5","Type":"ContainerStarted","Data":"60a70a587f0f01271bbb56034dec9e0fecff3bc0647ef052022b5554b62298fa"}
Jul 31 21:42:34.975611 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:34.975525    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:42:34.994534 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:34.994492    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42" podStartSLOduration=1.572640889 podStartE2EDuration="4.994479464s" totalImagesPullingTime="3.421838575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:34.994330093 +0000 UTC m=+381.077338895" watchObservedRunningTime="2026-07-31 21:42:34.994479464 +0000 UTC m=+381.077488269"
Jul 31 21:42:35.024079 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:42:35.024045    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg" podStartSLOduration=1.6316364810000001 podStartE2EDuration="5.024033677s" totalImagesPullingTime="3.392397196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:42:35.022152253 +0000 UTC m=+381.105161057" watchObservedRunningTime="2026-07-31 21:42:35.024033677 +0000 UTC m=+381.107042481"
Jul 31 21:43:05.981301 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:05.981262    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6whzg"
Jul 31 21:43:05.984165 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:05.984141    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jj42"
Jul 31 21:43:36.635466 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.635433    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"]
Jul 31 21:43:36.639407 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.639389    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:36.642949 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.642925    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 31 21:43:36.642949 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.642946    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 21:43:36.643130 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.642947    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hfphr\""
Jul 31 21:43:36.643130 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.643018    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 21:43:36.655486 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.655463    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"]
Jul 31 21:43:36.722693 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.722669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2hqq\" (UniqueName: \"kubernetes.io/projected/9a605505-a759-441f-81d5-c897353b92aa-kube-api-access-f2hqq\") pod \"dns-operator-controller-manager-5985564776-49ccn\" (UID: \"9a605505-a759-441f-81d5-c897353b92aa\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:36.823578 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.823552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2hqq\" (UniqueName: \"kubernetes.io/projected/9a605505-a759-441f-81d5-c897353b92aa-kube-api-access-f2hqq\") pod \"dns-operator-controller-manager-5985564776-49ccn\" (UID: \"9a605505-a759-441f-81d5-c897353b92aa\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:36.837866 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.837839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2hqq\" (UniqueName: \"kubernetes.io/projected/9a605505-a759-441f-81d5-c897353b92aa-kube-api-access-f2hqq\") pod \"dns-operator-controller-manager-5985564776-49ccn\" (UID: \"9a605505-a759-441f-81d5-c897353b92aa\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:36.948816 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:36.948761    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:37.083937 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:37.083868    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"]
Jul 31 21:43:37.086766 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:43:37.086733    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a605505_a759_441f_81d5_c897353b92aa.slice/crio-fe990d91d001113a1112ea7d901e7890e72d47fa5cac44605ab4eaaf3fd24a86 WatchSource:0}: Error finding container fe990d91d001113a1112ea7d901e7890e72d47fa5cac44605ab4eaaf3fd24a86: Status 404 returned error can't find the container with id fe990d91d001113a1112ea7d901e7890e72d47fa5cac44605ab4eaaf3fd24a86
Jul 31 21:43:37.207657 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:37.207592    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn" event={"ID":"9a605505-a759-441f-81d5-c897353b92aa","Type":"ContainerStarted","Data":"fe990d91d001113a1112ea7d901e7890e72d47fa5cac44605ab4eaaf3fd24a86"}
Jul 31 21:43:38.667575 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.667537    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"]
Jul 31 21:43:38.676166 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.676144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:38.680099 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.680073    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pkjrv\""
Jul 31 21:43:38.692190 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.692144    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"]
Jul 31 21:43:38.738697 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.738670    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6hl\" (UniqueName: \"kubernetes.io/projected/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3-kube-api-access-7d6hl\") pod \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" (UID: \"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:38.839904 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.839869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6hl\" (UniqueName: \"kubernetes.io/projected/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3-kube-api-access-7d6hl\") pod \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" (UID: \"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:38.852975 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.852936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6hl\" (UniqueName: \"kubernetes.io/projected/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3-kube-api-access-7d6hl\") pod \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" (UID: \"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:38.988632 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:38.988586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:39.622504 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:39.622482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"]
Jul 31 21:43:39.624388 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:43:39.624355    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf70c923_9dba_4ee8_9753_cb0e0ab66cb3.slice/crio-c2b2460cd0ff6f1396013240cd0cc1e4ed7265bc4e0cec6a95db3dc1a845fc60 WatchSource:0}: Error finding container c2b2460cd0ff6f1396013240cd0cc1e4ed7265bc4e0cec6a95db3dc1a845fc60: Status 404 returned error can't find the container with id c2b2460cd0ff6f1396013240cd0cc1e4ed7265bc4e0cec6a95db3dc1a845fc60
Jul 31 21:43:40.222255 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:40.222205    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn" event={"ID":"9a605505-a759-441f-81d5-c897353b92aa","Type":"ContainerStarted","Data":"f35fd5fe818c3faeff9654658531fb65ed637f76969342c9fef7b47bc8d83b2b"}
Jul 31 21:43:40.222662 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:40.222308    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:40.223634 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:40.223610    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7" event={"ID":"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3","Type":"ContainerStarted","Data":"c2b2460cd0ff6f1396013240cd0cc1e4ed7265bc4e0cec6a95db3dc1a845fc60"}
Jul 31 21:43:40.246300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:40.246258    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn" podStartSLOduration=1.783083395 podStartE2EDuration="4.246245914s" totalImagesPullingTime="2.463162519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:43:40.244078231 +0000 UTC m=+446.327087036" watchObservedRunningTime="2026-07-31 21:43:40.246245914 +0000 UTC m=+446.329254719"
Jul 31 21:43:42.234197 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:42.234156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7" event={"ID":"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3","Type":"ContainerStarted","Data":"519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa"}
Jul 31 21:43:42.234710 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:42.234236    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:42.261711 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:42.261661    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7" podStartSLOduration=2.576394125 podStartE2EDuration="4.26164494s" totalImagesPullingTime="1.685250815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:43:42.261441627 +0000 UTC m=+448.344450431" watchObservedRunningTime="2026-07-31 21:43:42.26164494 +0000 UTC m=+448.344653744"
Jul 31 21:43:46.158304 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.158270    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-kjjmz"]
Jul 31 21:43:46.161530 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.161513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:43:46.165849 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.165823    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-td96r\""
Jul 31 21:43:46.194387 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.194364    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-kjjmz"]
Jul 31 21:43:46.197264 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.197238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqlw\" (UniqueName: \"kubernetes.io/projected/a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36-kube-api-access-2bqlw\") pod \"authorino-operator-68d88948d8-kjjmz\" (UID: \"a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36\") " pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:43:46.298251 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.298224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqlw\" (UniqueName: \"kubernetes.io/projected/a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36-kube-api-access-2bqlw\") pod \"authorino-operator-68d88948d8-kjjmz\" (UID: \"a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36\") " pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:43:46.309665 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.309638    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqlw\" (UniqueName: \"kubernetes.io/projected/a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36-kube-api-access-2bqlw\") pod \"authorino-operator-68d88948d8-kjjmz\" (UID: \"a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36\") " pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:43:46.471579 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.471547    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:43:46.614185 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:46.614008    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-kjjmz"]
Jul 31 21:43:46.616552 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:43:46.616526    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c86e55_7b8f_4bb8_939d_d20cb2a6ab36.slice/crio-9f6a7e5b7af561eda3957f40d045e64d71c8909e093e315f5eb02bc346e9e0e8 WatchSource:0}: Error finding container 9f6a7e5b7af561eda3957f40d045e64d71c8909e093e315f5eb02bc346e9e0e8: Status 404 returned error can't find the container with id 9f6a7e5b7af561eda3957f40d045e64d71c8909e093e315f5eb02bc346e9e0e8
Jul 31 21:43:47.255541 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:47.255503    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz" event={"ID":"a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36","Type":"ContainerStarted","Data":"9f6a7e5b7af561eda3957f40d045e64d71c8909e093e315f5eb02bc346e9e0e8"}
Jul 31 21:43:48.261742 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:48.261714    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz" event={"ID":"a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36","Type":"ContainerStarted","Data":"d012d8dce499271c130eee5c9a53a36b74fa59c8588ffda48be6472aa473d43c"}
Jul 31 21:43:48.262133 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:48.261854    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:43:48.283769 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:48.283719    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz" podStartSLOduration=0.802163572 podStartE2EDuration="2.28370435s" totalImagesPullingTime="1.481540778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:43:48.281444183 +0000 UTC m=+454.364452988" watchObservedRunningTime="2026-07-31 21:43:48.28370435 +0000 UTC m=+454.366713155"
Jul 31 21:43:51.231403 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:51.231374    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-49ccn"
Jul 31 21:43:53.240439 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:53.240408    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:43:59.268061 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:43:59.268032    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-kjjmz"
Jul 31 21:44:01.989871 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:01.989839    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"]
Jul 31 21:44:01.990280 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:01.990054    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" containerName="manager" containerID="cri-o://519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa" gracePeriod=2
Jul 31 21:44:02.000231 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.000208    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"]
Jul 31 21:44:02.034303 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.034273    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"]
Jul 31 21:44:02.034724 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.034705    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" containerName="manager"
Jul 31 21:44:02.034797 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.034728    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" containerName="manager"
Jul 31 21:44:02.034850 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.034815    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" containerName="manager"
Jul 31 21:44:02.037633 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.037616    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:02.054327 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.054302    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"]
Jul 31 21:44:02.085342 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:44:02.085311    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" is forbidden: User \"system:node:ip-10-0-142-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-220.ec2.internal' and this object" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:44:02.116148 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.116120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lrnr\" (UniqueName: \"kubernetes.io/projected/71f32b33-7766-4bae-bdc6-fcf8fb40ec3e-kube-api-access-5lrnr\") pod \"limitador-operator-controller-manager-6c549b6d85-2fgvp\" (UID: \"71f32b33-7766-4bae-bdc6-fcf8fb40ec3e\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:02.216488 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.216463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lrnr\" (UniqueName: \"kubernetes.io/projected/71f32b33-7766-4bae-bdc6-fcf8fb40ec3e-kube-api-access-5lrnr\") pod \"limitador-operator-controller-manager-6c549b6d85-2fgvp\" (UID: \"71f32b33-7766-4bae-bdc6-fcf8fb40ec3e\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:02.219343 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.219326    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:44:02.222026 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:44:02.222003    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" is forbidden: User \"system:node:ip-10-0-142-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-220.ec2.internal' and this object" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:44:02.250920 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.250870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lrnr\" (UniqueName: \"kubernetes.io/projected/71f32b33-7766-4bae-bdc6-fcf8fb40ec3e-kube-api-access-5lrnr\") pod \"limitador-operator-controller-manager-6c549b6d85-2fgvp\" (UID: \"71f32b33-7766-4bae-bdc6-fcf8fb40ec3e\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:02.317189 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.317168    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d6hl\" (UniqueName: \"kubernetes.io/projected/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3-kube-api-access-7d6hl\") pod \"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3\" (UID: \"bf70c923-9dba-4ee8-9753-cb0e0ab66cb3\") "
Jul 31 21:44:02.319374 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.319347    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3-kube-api-access-7d6hl" (OuterVolumeSpecName: "kube-api-access-7d6hl") pod "bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" (UID: "bf70c923-9dba-4ee8-9753-cb0e0ab66cb3"). InnerVolumeSpecName "kube-api-access-7d6hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:44:02.321986 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.321953    2557 generic.go:356] "Generic (PLEG): container finished" podID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" containerID="519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa" exitCode=0
Jul 31 21:44:02.322062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.322014    2557 scope.go:117] "RemoveContainer" containerID="519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa"
Jul 31 21:44:02.322062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.322032    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:44:02.325084 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:44:02.325056    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" is forbidden: User \"system:node:ip-10-0-142-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-220.ec2.internal' and this object" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:44:02.330085 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.330069    2557 scope.go:117] "RemoveContainer" containerID="519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa"
Jul 31 21:44:02.330348 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:44:02.330329    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa\": container with ID starting with 519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa not found: ID does not exist" containerID="519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa"
Jul 31 21:44:02.330400 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.330357    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa"} err="failed to get container status \"519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa\": rpc error: code = NotFound desc = could not find container \"519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa\": container with ID starting with 519ccc454ea03b25d32f29d0648d20d59e8589950f5ba321b49a70256ded29aa not found: ID does not exist"
Jul 31 21:44:02.335745 ip-10-0-142-220 kubenswrapper[2557]: E0731 21:44:02.335719    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-8dkr7\" is forbidden: User \"system:node:ip-10-0-142-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-220.ec2.internal' and this object" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-8dkr7"
Jul 31 21:44:02.364909 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.364883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:02.418284 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.418249    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d6hl\" (UniqueName: \"kubernetes.io/projected/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3-kube-api-access-7d6hl\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 21:44:02.486132 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.486100    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf70c923-9dba-4ee8-9753-cb0e0ab66cb3" path="/var/lib/kubelet/pods/bf70c923-9dba-4ee8-9753-cb0e0ab66cb3/volumes"
Jul 31 21:44:02.493982 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:02.493942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"]
Jul 31 21:44:02.496928 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:44:02.496898    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f32b33_7766_4bae_bdc6_fcf8fb40ec3e.slice/crio-2b2e017148d1fa242b3fedabd50744c9149ddbc13dc85b83a50014d1332115a0 WatchSource:0}: Error finding container 2b2e017148d1fa242b3fedabd50744c9149ddbc13dc85b83a50014d1332115a0: Status 404 returned error can't find the container with id 2b2e017148d1fa242b3fedabd50744c9149ddbc13dc85b83a50014d1332115a0
Jul 31 21:44:03.328673 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:03.328632    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp" event={"ID":"71f32b33-7766-4bae-bdc6-fcf8fb40ec3e","Type":"ContainerStarted","Data":"c41c806d9a0e438f29641b27ee11a1feceb9967f9fef7a4469e631cbf8546663"}
Jul 31 21:44:03.329100 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:03.328695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp" event={"ID":"71f32b33-7766-4bae-bdc6-fcf8fb40ec3e","Type":"ContainerStarted","Data":"2b2e017148d1fa242b3fedabd50744c9149ddbc13dc85b83a50014d1332115a0"}
Jul 31 21:44:03.329100 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:03.328777    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:03.358641 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:03.355911    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp" podStartSLOduration=1.35589131 podStartE2EDuration="1.35589131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:03.354499496 +0000 UTC m=+469.437508306" watchObservedRunningTime="2026-07-31 21:44:03.35589131 +0000 UTC m=+469.438900115"
Jul 31 21:44:14.335092 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:14.335061    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2fgvp"
Jul 31 21:44:45.415465 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.415436    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:44:45.418547 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.418531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.421355 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.421326    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-t5g22\""
Jul 31 21:44:45.421500 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.421388    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 31 21:44:45.428300 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.428277    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:44:45.454411 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.454390    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:44:45.527388 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.527369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f7518f-0df5-478a-809e-cd1723c131f6-config-file\") pod \"limitador-limitador-85d9db4d5d-zv5br\" (UID: \"14f7518f-0df5-478a-809e-cd1723c131f6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.527496 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.527417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vr8\" (UniqueName: \"kubernetes.io/projected/14f7518f-0df5-478a-809e-cd1723c131f6-kube-api-access-n6vr8\") pod \"limitador-limitador-85d9db4d5d-zv5br\" (UID: \"14f7518f-0df5-478a-809e-cd1723c131f6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.628055 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.628037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f7518f-0df5-478a-809e-cd1723c131f6-config-file\") pod \"limitador-limitador-85d9db4d5d-zv5br\" (UID: \"14f7518f-0df5-478a-809e-cd1723c131f6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.628144 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.628085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vr8\" (UniqueName: \"kubernetes.io/projected/14f7518f-0df5-478a-809e-cd1723c131f6-kube-api-access-n6vr8\") pod \"limitador-limitador-85d9db4d5d-zv5br\" (UID: \"14f7518f-0df5-478a-809e-cd1723c131f6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.628630 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.628611    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/14f7518f-0df5-478a-809e-cd1723c131f6-config-file\") pod \"limitador-limitador-85d9db4d5d-zv5br\" (UID: \"14f7518f-0df5-478a-809e-cd1723c131f6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.636757 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.636729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vr8\" (UniqueName: \"kubernetes.io/projected/14f7518f-0df5-478a-809e-cd1723c131f6-kube-api-access-n6vr8\") pod \"limitador-limitador-85d9db4d5d-zv5br\" (UID: \"14f7518f-0df5-478a-809e-cd1723c131f6\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.730432 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.730412    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:45.857721 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:45.857694    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:44:45.859836 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:44:45.859805    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f7518f_0df5_478a_809e_cd1723c131f6.slice/crio-185693a0ac0641fa0f23c8bc96ce52da484894b349f62247e634a6501094866d WatchSource:0}: Error finding container 185693a0ac0641fa0f23c8bc96ce52da484894b349f62247e634a6501094866d: Status 404 returned error can't find the container with id 185693a0ac0641fa0f23c8bc96ce52da484894b349f62247e634a6501094866d
Jul 31 21:44:46.502433 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:46.502401    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br" event={"ID":"14f7518f-0df5-478a-809e-cd1723c131f6","Type":"ContainerStarted","Data":"185693a0ac0641fa0f23c8bc96ce52da484894b349f62247e634a6501094866d"}
Jul 31 21:44:47.507981 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:47.507930    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br" event={"ID":"14f7518f-0df5-478a-809e-cd1723c131f6","Type":"ContainerStarted","Data":"f06d9daf5779072cc6a569163064e418fe278487d4124bb6c3824f1873d09134"}
Jul 31 21:44:47.508419 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:47.508103    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:44:47.527741 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:47.527696    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br" podStartSLOduration=1.305419688 podStartE2EDuration="2.527682596s" totalImagesPullingTime="1.222262908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:44:47.526501478 +0000 UTC m=+513.609510283" watchObservedRunningTime="2026-07-31 21:44:47.527682596 +0000 UTC m=+513.610691401"
Jul 31 21:44:58.512806 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:44:58.512771    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"
Jul 31 21:45:55.772129 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:45:55.772099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:46:12.759236 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:12.759202    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:46:14.359878 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:14.359848    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:46:14.361126 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:14.361100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:46:29.335678 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:29.335644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:46:42.530654 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:42.530576    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:46:51.515907 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.515879    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"]
Jul 31 21:46:51.519198 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.519180    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.521780 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.521761    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 31 21:46:51.523109 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.523083    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 21:46:51.523209 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.523150    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 21:46:51.523209 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.523185    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mxvc5\""
Jul 31 21:46:51.532200 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.532180    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"]
Jul 31 21:46:51.555347 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.555326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.555446 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.555354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.555446 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.555372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.555526 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.555510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.555565 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.555540    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjkj\" (UniqueName: \"kubernetes.io/projected/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-kube-api-access-qcjkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.555633 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.555616    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656210 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656339 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656339 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656254    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656339 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656277    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656339 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656546 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjkj\" (UniqueName: \"kubernetes.io/projected/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-kube-api-access-qcjkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656639 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656614    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656705 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656669    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.656777 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.656757    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.658586 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.658560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.658862 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.658841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.668329 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.668301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjkj\" (UniqueName: \"kubernetes.io/projected/9aa67ff7-bad1-49a1-89d5-93eef8aff3db-kube-api-access-qcjkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9\" (UID: \"9aa67ff7-bad1-49a1-89d5-93eef8aff3db\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.829374 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.829294    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:46:51.952910 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.952884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"]
Jul 31 21:46:51.954926 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:46:51.954898    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa67ff7_bad1_49a1_89d5_93eef8aff3db.slice/crio-9624e46f34c7c61341dc31f3668078245dc9ed509c5f53cf2d362ef837f9f3db WatchSource:0}: Error finding container 9624e46f34c7c61341dc31f3668078245dc9ed509c5f53cf2d362ef837f9f3db: Status 404 returned error can't find the container with id 9624e46f34c7c61341dc31f3668078245dc9ed509c5f53cf2d362ef837f9f3db
Jul 31 21:46:51.956159 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:51.956143    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:46:52.016921 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:52.016892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9" event={"ID":"9aa67ff7-bad1-49a1-89d5-93eef8aff3db","Type":"ContainerStarted","Data":"9624e46f34c7c61341dc31f3668078245dc9ed509c5f53cf2d362ef837f9f3db"}
Jul 31 21:46:52.635263 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:52.635234    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:46:54.027733 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:54.027701    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9" event={"ID":"9aa67ff7-bad1-49a1-89d5-93eef8aff3db","Type":"ContainerStarted","Data":"6d69b678a1dc63b8e9a5fdb802a592a9370f20d62948da4ef536f7ff4c49d4df"}
Jul 31 21:46:54.047109 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:46:54.047068    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9" podStartSLOduration=2.019083212 podStartE2EDuration="3.047054891s" totalImagesPullingTime="1.027971679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:46:54.046536866 +0000 UTC m=+640.129545673" watchObservedRunningTime="2026-07-31 21:46:54.047054891 +0000 UTC m=+640.130063696"
Jul 31 21:47:01.829663 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:01.829630    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:47:01.830199 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:01.829698    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:47:01.841995 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:01.841974    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:47:02.072266 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:02.072240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9"
Jul 31 21:47:07.930563 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:07.930524    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:47:10.312993 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.312948    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"]
Jul 31 21:47:10.316301 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.316280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.319406 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.319385    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 31 21:47:10.331828 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.331808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"]
Jul 31 21:47:10.400113 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.400081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.400241 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.400134    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.400241 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.400177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.400241 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.400205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4282806-db08-4480-bb4b-fcc2131d7ad7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.400241 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.400225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqvt6\" (UniqueName: \"kubernetes.io/projected/a4282806-db08-4480-bb4b-fcc2131d7ad7-kube-api-access-mqvt6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.400400 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.400264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.500843 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.500814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501016 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.500848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501016 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.500867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4282806-db08-4480-bb4b-fcc2131d7ad7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501016 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.500883    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqvt6\" (UniqueName: \"kubernetes.io/projected/a4282806-db08-4480-bb4b-fcc2131d7ad7-kube-api-access-mqvt6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501016 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.500911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501016 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.500949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501339 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.501307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501458 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.501350    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.501458 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.501390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.503002 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.502986    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4282806-db08-4480-bb4b-fcc2131d7ad7-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.503309 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.503292    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4282806-db08-4480-bb4b-fcc2131d7ad7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.508527 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.508502    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqvt6\" (UniqueName: \"kubernetes.io/projected/a4282806-db08-4480-bb4b-fcc2131d7ad7-kube-api-access-mqvt6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh\" (UID: \"a4282806-db08-4480-bb4b-fcc2131d7ad7\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.624657 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.624586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:10.753301 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:10.753276    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"]
Jul 31 21:47:10.755073 ip-10-0-142-220 kubenswrapper[2557]: W0731 21:47:10.755046    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4282806_db08_4480_bb4b_fcc2131d7ad7.slice/crio-31e924e6a6223570a41dec935e91217c5e7d39e16c8f0703c03469c4e61bde35 WatchSource:0}: Error finding container 31e924e6a6223570a41dec935e91217c5e7d39e16c8f0703c03469c4e61bde35: Status 404 returned error can't find the container with id 31e924e6a6223570a41dec935e91217c5e7d39e16c8f0703c03469c4e61bde35
Jul 31 21:47:11.101282 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:11.101246    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh" event={"ID":"a4282806-db08-4480-bb4b-fcc2131d7ad7","Type":"ContainerStarted","Data":"6e92ecfe04617daf695f841f0afe8378f45a68ceb37eac46aa397318345b0292"}
Jul 31 21:47:11.101282 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:11.101294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh" event={"ID":"a4282806-db08-4480-bb4b-fcc2131d7ad7","Type":"ContainerStarted","Data":"31e924e6a6223570a41dec935e91217c5e7d39e16c8f0703c03469c4e61bde35"}
Jul 31 21:47:11.118898 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:11.118841    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh" podStartSLOduration=0.947753105 podStartE2EDuration="1.118826363s" totalImagesPullingTime="171.073258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:47:11.118676372 +0000 UTC m=+657.201685178" watchObservedRunningTime="2026-07-31 21:47:11.118826363 +0000 UTC m=+657.201835233"
Jul 31 21:47:16.626944 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:16.626907    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:47:20.625059 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:20.625022    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:20.625473 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:20.625283    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:20.637567 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:20.637542    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:47:21.158364 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:47:21.158334    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh"
Jul 31 21:48:42.023084 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:48:42.023006    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:48:51.018773 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:48:51.018739    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:49:02.525930 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:49:02.525892    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:50:44.723625 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:50:44.723590    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:50:52.729654 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:50:52.729623    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:51:14.383937 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:51:14.383862    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:51:14.384343 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:51:14.383862    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:51:51.427054 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:51:51.427017    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:51:58.725549 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:51:58.725516    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:14.126838 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:14.126800    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:20.027611 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:20.027576    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:29.530002 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:29.529952    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:35.670248 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:35.670209    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:50.122260 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:50.122182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:54.834546 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:54.834512    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:52:59.822992 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:52:59.822947    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:53:04.427281 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:53:04.427243    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:53:09.520190 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:53:09.520155    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:53:21.928167 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:53:21.928130    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:53:32.659330 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:53:32.659294    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:53:55.430079 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:53:55.430047    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:06.019225 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:06.019185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:12.034127 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:12.033064    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:18.528023 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:18.527990    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:25.627628 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:25.627596    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:31.431438 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:31.431395    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:37.829362 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:37.829315    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:43.931514 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:43.931477    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:54:56.524968 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:54:56.524925    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:04.428118 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:04.428083    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:14.636645 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:14.636610    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:19.725046 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:19.725013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:25.531251 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:25.531217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:34.924206 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:34.924171    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:41.132560 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:41.132482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:55:51.026845 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:55:51.026808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:56:14.410835 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:56:14.410803    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:56:14.413249 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:56:14.413226    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 21:58:06.924062 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:58:06.924013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:58:13.125882 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:58:13.125841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:58:35.120092 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:58:35.120051    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:58:46.240267 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:58:46.240184    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:58:56.641166 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:58:56.641131    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:01.621771 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:01.621738    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:07.028018 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:07.027982    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:16.924573 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:16.924539    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:22.635576 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:22.635528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:32.223183 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:32.223148    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:38.327456 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:38.327422    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:47.528464 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:47.528427    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 21:59:54.025330 ip-10-0-142-220 kubenswrapper[2557]: I0731 21:59:54.025289    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:00:03.431812 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:00:03.431775    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:00:25.422753 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:00:25.422719    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:00:32.429666 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:00:32.429622    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:00:42.426177 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:00:42.426136    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:00:51.238039 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:00:51.238002    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:01:14.433692 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:14.433656    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:01:14.436645 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:14.436624    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:01:27.429290 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:27.429255    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:01:39.321532 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:39.321453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:01:45.426259 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:45.426225    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:01:52.625936 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:52.625897    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:01:59.226168 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:01:59.226127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:05.427373 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:05.427341    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:12.219253 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:12.219215    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:18.528916 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:18.528883    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:23.725671 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:23.725627    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:33.923619 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:33.923585    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:41.129208 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:41.129177    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:02:56.426533 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:02:56.426498    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:03.723724 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:03.723686    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:15.062108 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:15.062030    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:21.630740 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:21.630703    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:29.328872 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:29.328833    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:34.322529 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:34.322497    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:41.719189 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:41.719156    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:48.219608 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:48.219567    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:03:55.534717 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:03:55.534681    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:04:04.927798 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:04:04.927763    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:04:11.223202 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:04:11.223167    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:04:22.026988 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:04:22.026940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:04:37.130763 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:04:37.130684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:04:43.223453 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:04:43.223418    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:04:51.119842 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:04:51.119808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:05:00.923813 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:05:00.923776    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:05:09.425047 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:05:09.425010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:05:14.932278 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:05:14.932241    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:05:29.124770 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:05:29.124734    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:05:59.533447 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:05:59.533416    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:06:05.618108 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:06:05.618073    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:06:14.456672 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:06:14.456644    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:06:14.461350 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:06:14.461329    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:06:40.930304 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:06:40.930269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:06:49.324755 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:06:49.324714    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:07:15.726809 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:07:15.726774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:07:22.421629 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:07:22.421593    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:07:51.931611 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:07:51.931517    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:08:03.522192 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:08:03.522161    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:09:35.324816 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:09:35.324744    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:09:42.330928 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:09:42.330890    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:09:55.822135 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:09:55.822098    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:10:36.630581 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:10:36.630544    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:11:12.929976 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:11:12.929933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:11:14.478867 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:11:14.478841    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:11:14.485662 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:11:14.485637    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:12:57.431594 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:12:57.431556    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:13:04.119219 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:04.119190    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:13:27.022578 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.022548    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"]
Jul 31 22:13:27.025664 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.025648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.028270 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.028246    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b0a39ff7\"/\"openshift-service-ca.crt\""
Jul 31 22:13:27.029593 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.029575    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b0a39ff7\"/\"kube-root-ca.crt\""
Jul 31 22:13:27.029675 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.029657    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b0a39ff7\"/\"default-dockercfg-7phcq\""
Jul 31 22:13:27.029945 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.029931    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b0a39ff7\"/\"e2e-lifecycle-model-b0a39ff7-kserve-self-signed-certs\""
Jul 31 22:13:27.034936 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.034914    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"]
Jul 31 22:13:27.099874 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.099846    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tls-certs\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.099874 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.099875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzdv2\" (UniqueName: \"kubernetes.io/projected/5b5cf922-4d32-45db-af1d-f5f948fef4fa-kube-api-access-pzdv2\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.100064 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.099900    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-model-cache\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.100064 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.099975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tmp-dir\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.100064 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.100021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-dshm\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.100167 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.100064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-home\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201385 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201351    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-model-cache\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201554 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tmp-dir\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201554 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201448    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-dshm\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201554 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-home\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201554 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tls-certs\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201751 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzdv2\" (UniqueName: \"kubernetes.io/projected/5b5cf922-4d32-45db-af1d-f5f948fef4fa-kube-api-access-pzdv2\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-model-cache\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.201934 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-home\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.202002 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.201936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tmp-dir\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.203729 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.203707    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-dshm\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.203912 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.203893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tls-certs\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.211781 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.211756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzdv2\" (UniqueName: \"kubernetes.io/projected/5b5cf922-4d32-45db-af1d-f5f948fef4fa-kube-api-access-pzdv2\") pod \"e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") " pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.335023 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.334905    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:27.463374 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.463330    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"]
Jul 31 22:13:27.465435 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:13:27.465409    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b5cf922_4d32_45db_af1d_f5f948fef4fa.slice/crio-6de78d2ea1880c56f458207c6d9deee76ce9f22ff87a6111795bcef2dc382961 WatchSource:0}: Error finding container 6de78d2ea1880c56f458207c6d9deee76ce9f22ff87a6111795bcef2dc382961: Status 404 returned error can't find the container with id 6de78d2ea1880c56f458207c6d9deee76ce9f22ff87a6111795bcef2dc382961
Jul 31 22:13:27.798516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.798477    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd" event={"ID":"5b5cf922-4d32-45db-af1d-f5f948fef4fa","Type":"ContainerStarted","Data":"99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35"}
Jul 31 22:13:27.798516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.798524    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd" event={"ID":"5b5cf922-4d32-45db-af1d-f5f948fef4fa","Type":"ContainerStarted","Data":"6de78d2ea1880c56f458207c6d9deee76ce9f22ff87a6111795bcef2dc382961"}
Jul 31 22:13:27.819677 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:27.819627    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd" podStartSLOduration=0.819611981 podStartE2EDuration="819.611981ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:13:27.81795202 +0000 UTC m=+2233.900960825" watchObservedRunningTime="2026-07-31 22:13:27.819611981 +0000 UTC m=+2233.902620786"
Jul 31 22:13:29.442796 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:29.442764    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:13:37.335790 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:37.335708    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:37.335790 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:37.335754    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:37.348235 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:37.348211    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:37.851724 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:37.851698    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:13:48.820876 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:13:48.820835    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:14:12.636454 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:12.636417    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:14:18.528165 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:18.528126    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:14:23.338478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:23.338444    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"]
Jul 31 22:14:38.357823 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.357759    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd" podUID="5b5cf922-4d32-45db-af1d-f5f948fef4fa" containerName="main" containerID="cri-o://99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35" gracePeriod=45
Jul 31 22:14:38.596744 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.596719    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:14:38.656002 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.655925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-dshm\") pod \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") "
Jul 31 22:14:38.656002 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.655971    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzdv2\" (UniqueName: \"kubernetes.io/projected/5b5cf922-4d32-45db-af1d-f5f948fef4fa-kube-api-access-pzdv2\") pod \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") "
Jul 31 22:14:38.656002 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.655990    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tmp-dir\") pod \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") "
Jul 31 22:14:38.656249 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.656034    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-model-cache\") pod \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") "
Jul 31 22:14:38.656249 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.656070    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-home\") pod \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") "
Jul 31 22:14:38.656249 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.656136    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tls-certs\") pod \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\" (UID: \"5b5cf922-4d32-45db-af1d-f5f948fef4fa\") "
Jul 31 22:14:38.656391 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.656297    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b5cf922-4d32-45db-af1d-f5f948fef4fa" (UID: "5b5cf922-4d32-45db-af1d-f5f948fef4fa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:14:38.656391 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.656304    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b5cf922-4d32-45db-af1d-f5f948fef4fa" (UID: "5b5cf922-4d32-45db-af1d-f5f948fef4fa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:14:38.656692 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.656663    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-home" (OuterVolumeSpecName: "home") pod "5b5cf922-4d32-45db-af1d-f5f948fef4fa" (UID: "5b5cf922-4d32-45db-af1d-f5f948fef4fa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:14:38.658170 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.658148    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-dshm" (OuterVolumeSpecName: "dshm") pod "5b5cf922-4d32-45db-af1d-f5f948fef4fa" (UID: "5b5cf922-4d32-45db-af1d-f5f948fef4fa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:14:38.658279 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.658229    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b5cf922-4d32-45db-af1d-f5f948fef4fa" (UID: "5b5cf922-4d32-45db-af1d-f5f948fef4fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:14:38.658337 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.658285    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b5cf922-4d32-45db-af1d-f5f948fef4fa-kube-api-access-pzdv2" (OuterVolumeSpecName: "kube-api-access-pzdv2") pod "5b5cf922-4d32-45db-af1d-f5f948fef4fa" (UID: "5b5cf922-4d32-45db-af1d-f5f948fef4fa"). InnerVolumeSpecName "kube-api-access-pzdv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:14:38.756923 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.756897    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:14:38.756923 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.756920    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:14:38.757083 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.756928    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzdv2\" (UniqueName: \"kubernetes.io/projected/5b5cf922-4d32-45db-af1d-f5f948fef4fa-kube-api-access-pzdv2\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:14:38.757083 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.756938    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:14:38.757083 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.756948    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:14:38.757083 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:38.756966    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b5cf922-4d32-45db-af1d-f5f948fef4fa-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:14:39.110695 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.110666    2557 generic.go:356] "Generic (PLEG): container finished" podID="5b5cf922-4d32-45db-af1d-f5f948fef4fa" containerID="99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35" exitCode=0
Jul 31 22:14:39.110847 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.110709    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"
Jul 31 22:14:39.110847 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.110723    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd" event={"ID":"5b5cf922-4d32-45db-af1d-f5f948fef4fa","Type":"ContainerDied","Data":"99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35"}
Jul 31 22:14:39.110847 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.110768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd" event={"ID":"5b5cf922-4d32-45db-af1d-f5f948fef4fa","Type":"ContainerDied","Data":"6de78d2ea1880c56f458207c6d9deee76ce9f22ff87a6111795bcef2dc382961"}
Jul 31 22:14:39.110847 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.110792    2557 scope.go:117] "RemoveContainer" containerID="99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35"
Jul 31 22:14:39.120057 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.120039    2557 scope.go:117] "RemoveContainer" containerID="99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35"
Jul 31 22:14:39.120306 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:14:39.120286    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35\": container with ID starting with 99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35 not found: ID does not exist" containerID="99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35"
Jul 31 22:14:39.120349 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.120315    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35"} err="failed to get container status \"99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35\": rpc error: code = NotFound desc = could not find container \"99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35\": container with ID starting with 99a765596ed96b8f114932305075436d209a58fbfb4942c1a3c50a925afc6c35 not found: ID does not exist"
Jul 31 22:14:39.134139 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.134115    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"]
Jul 31 22:14:39.137431 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:39.137411    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b0a39ff7/e2e-lifecycle-model-b0a39ff7-kserve-56fddd644c-gcqmd"]
Jul 31 22:14:40.485849 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:14:40.485818    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b5cf922-4d32-45db-af1d-f5f948fef4fa" path="/var/lib/kubelet/pods/5b5cf922-4d32-45db-af1d-f5f948fef4fa/volumes"
Jul 31 22:15:08.527051 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:15:08.526949    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:15:20.332308 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:15:20.332246    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:15:27.927952 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:15:27.927915    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:16:14.505998 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:16:14.505953    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:16:14.512062 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:16:14.512041    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:16:18.424060 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:16:18.424018    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:16:47.981830 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:16:47.981754    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:17:24.321253 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.321216    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"]
Jul 31 22:17:24.321726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.321552    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b5cf922-4d32-45db-af1d-f5f948fef4fa" containerName="main"
Jul 31 22:17:24.321726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.321564    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b5cf922-4d32-45db-af1d-f5f948fef4fa" containerName="main"
Jul 31 22:17:24.321726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.321629    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b5cf922-4d32-45db-af1d-f5f948fef4fa" containerName="main"
Jul 31 22:17:24.324351 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.324332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.327202 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.327183    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0ac91e\"/\"kube-root-ca.crt\""
Jul 31 22:17:24.328172 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.328148    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0ac91e\"/\"default-dockercfg-dt9ml\""
Jul 31 22:17:24.328284 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.328232    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-0ac91e\"/\"openshift-service-ca.crt\""
Jul 31 22:17:24.328367 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.328346    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-0ac91e\"/\"test-model-0ac91e-kserve-self-signed-certs\""
Jul 31 22:17:24.347157 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.347127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"]
Jul 31 22:17:24.349630 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.349610    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-model-cache\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.349722 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.349640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhqt\" (UniqueName: \"kubernetes.io/projected/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-kube-api-access-ghhqt\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.349722 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.349662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-home\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.349800 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.349758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tmp-dir\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.349838 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.349798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-dshm\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.349875 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.349854    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tls-certs\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.450578 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.450548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-home\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.450705 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.450591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tmp-dir\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.450705 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.450610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-dshm\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.450705 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.450635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tls-certs\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.450705 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.450669    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-model-cache\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.450705 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.450686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhqt\" (UniqueName: \"kubernetes.io/projected/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-kube-api-access-ghhqt\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.451051 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.451031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tmp-dir\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.451128 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.451040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-home\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.451128 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.451091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-model-cache\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.452836 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.452807    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-dshm\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.453168 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.453147    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tls-certs\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.464385 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.464357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhqt\" (UniqueName: \"kubernetes.io/projected/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-kube-api-access-ghhqt\") pod \"test-model-0ac91e-kserve-598858fd99-5jw5w\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") " pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.633789 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.633726    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:24.753434 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.753403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"]
Jul 31 22:17:24.755742 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:17:24.755718    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7d101b2_76af_48ee_9777_dcbeaf9cfae7.slice/crio-2397ed2f37ecf759eb59adab8953c7c8584ee9eed0647276fd79aaa07453bb22 WatchSource:0}: Error finding container 2397ed2f37ecf759eb59adab8953c7c8584ee9eed0647276fd79aaa07453bb22: Status 404 returned error can't find the container with id 2397ed2f37ecf759eb59adab8953c7c8584ee9eed0647276fd79aaa07453bb22
Jul 31 22:17:24.837401 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.837370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w" event={"ID":"c7d101b2-76af-48ee-9777-dcbeaf9cfae7","Type":"ContainerStarted","Data":"156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13"}
Jul 31 22:17:24.837511 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.837414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w" event={"ID":"c7d101b2-76af-48ee-9777-dcbeaf9cfae7","Type":"ContainerStarted","Data":"2397ed2f37ecf759eb59adab8953c7c8584ee9eed0647276fd79aaa07453bb22"}
Jul 31 22:17:24.854147 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:24.854107    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w" podStartSLOduration=0.854093744 podStartE2EDuration="854.093744ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:17:24.852282572 +0000 UTC m=+2470.935291376" watchObservedRunningTime="2026-07-31 22:17:24.854093744 +0000 UTC m=+2470.937102551"
Jul 31 22:17:27.329173 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:27.329138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:17:34.634820 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:34.634784    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:34.635217 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:34.634831    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:34.647037 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:34.647016    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:34.889063 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:34.888992    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:17:46.814057 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.814025    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"]
Jul 31 22:17:46.817501 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.817476    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:46.819968 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.819931    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d0110c\"/\"openshift-service-ca.crt\""
Jul 31 22:17:46.820979 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.820944    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d0110c\"/\"kube-root-ca.crt\""
Jul 31 22:17:46.820979 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.820951    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d0110c\"/\"test-model-d0110c-kserve-self-signed-certs\""
Jul 31 22:17:46.821231 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.821216    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d0110c\"/\"default-dockercfg-p8dlq\""
Jul 31 22:17:46.835063 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.835044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"]
Jul 31 22:17:46.910310 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.910248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-dshm\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:46.910504 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.910487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-home\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:46.910627 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.910612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74ed20e-b791-4814-8632-8091c35d0098-tls-certs\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:46.910740 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.910727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkww\" (UniqueName: \"kubernetes.io/projected/c74ed20e-b791-4814-8632-8091c35d0098-kube-api-access-8xkww\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:46.910866 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.910852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-tmp-dir\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:46.910979 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:46.910945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-model-cache\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.011984 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.011935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-tmp-dir\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.011984 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.011986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-model-cache\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012157 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012016    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-dshm\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012157 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012031    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-home\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012157 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74ed20e-b791-4814-8632-8091c35d0098-tls-certs\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012157 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkww\" (UniqueName: \"kubernetes.io/projected/c74ed20e-b791-4814-8632-8091c35d0098-kube-api-access-8xkww\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012377 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012353    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-tmp-dir\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012501 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-home\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.012501 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.012490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-model-cache\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.014332 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.014307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-dshm\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.014722 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.014702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74ed20e-b791-4814-8632-8091c35d0098-tls-certs\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.020786 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.020764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkww\" (UniqueName: \"kubernetes.io/projected/c74ed20e-b791-4814-8632-8091c35d0098-kube-api-access-8xkww\") pod \"test-model-d0110c-kserve-6765cf7dcf-f9sxx\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") " pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.126417 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.126359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:47.251421 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.251398    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"]
Jul 31 22:17:47.254132 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:17:47.254108    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc74ed20e_b791_4814_8632_8091c35d0098.slice/crio-f3b8c42f6b356e7e7373746f3741aec2f5794938e4184474d533a9d0f5df9dcb WatchSource:0}: Error finding container f3b8c42f6b356e7e7373746f3741aec2f5794938e4184474d533a9d0f5df9dcb: Status 404 returned error can't find the container with id f3b8c42f6b356e7e7373746f3741aec2f5794938e4184474d533a9d0f5df9dcb
Jul 31 22:17:47.933181 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.933145    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx" event={"ID":"c74ed20e-b791-4814-8632-8091c35d0098","Type":"ContainerStarted","Data":"93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06"}
Jul 31 22:17:47.933555 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.933189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx" event={"ID":"c74ed20e-b791-4814-8632-8091c35d0098","Type":"ContainerStarted","Data":"f3b8c42f6b356e7e7373746f3741aec2f5794938e4184474d533a9d0f5df9dcb"}
Jul 31 22:17:47.950016 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:47.949972    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx" podStartSLOduration=1.949942723 podStartE2EDuration="1.949942723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:17:47.948048729 +0000 UTC m=+2494.031057532" watchObservedRunningTime="2026-07-31 22:17:47.949942723 +0000 UTC m=+2494.032951527"
Jul 31 22:17:50.024997 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:50.024952    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:17:57.127109 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:57.127066    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:57.127109 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:57.127117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:57.139463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:57.139432    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:57.987716 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:57.987685    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:17:59.521640 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:17:59.521606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:18:28.760333 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:28.760248    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"]
Jul 31 22:18:29.652490 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:29.652461    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"]
Jul 31 22:18:31.727480 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:31.727451    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:18:42.952188 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:42.952158    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:18:43.778163 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:43.778124    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w" podUID="c7d101b2-76af-48ee-9777-dcbeaf9cfae7" containerName="main" containerID="cri-o://156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13" gracePeriod=45
Jul 31 22:18:44.017783 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.017761    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:18:44.129708 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129638    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-home\") pod \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") "
Jul 31 22:18:44.129708 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129710    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tmp-dir\") pod \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") "
Jul 31 22:18:44.129883 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129736    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tls-certs\") pod \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") "
Jul 31 22:18:44.129883 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129782    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-model-cache\") pod \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") "
Jul 31 22:18:44.129883 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129816    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghhqt\" (UniqueName: \"kubernetes.io/projected/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-kube-api-access-ghhqt\") pod \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") "
Jul 31 22:18:44.129883 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129852    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-dshm\") pod \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\" (UID: \"c7d101b2-76af-48ee-9777-dcbeaf9cfae7\") "
Jul 31 22:18:44.129883 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129857    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-home" (OuterVolumeSpecName: "home") pod "c7d101b2-76af-48ee-9777-dcbeaf9cfae7" (UID: "c7d101b2-76af-48ee-9777-dcbeaf9cfae7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:44.130114 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.129999    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c7d101b2-76af-48ee-9777-dcbeaf9cfae7" (UID: "c7d101b2-76af-48ee-9777-dcbeaf9cfae7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:44.130114 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.130077    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c7d101b2-76af-48ee-9777-dcbeaf9cfae7" (UID: "c7d101b2-76af-48ee-9777-dcbeaf9cfae7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:44.130184 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.130172    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:44.130241 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.130185    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:44.130241 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.130194    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:44.131855 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.131832    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c7d101b2-76af-48ee-9777-dcbeaf9cfae7" (UID: "c7d101b2-76af-48ee-9777-dcbeaf9cfae7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:18:44.131952 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.131874    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-dshm" (OuterVolumeSpecName: "dshm") pod "c7d101b2-76af-48ee-9777-dcbeaf9cfae7" (UID: "c7d101b2-76af-48ee-9777-dcbeaf9cfae7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:44.131952 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.131877    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-kube-api-access-ghhqt" (OuterVolumeSpecName: "kube-api-access-ghhqt") pod "c7d101b2-76af-48ee-9777-dcbeaf9cfae7" (UID: "c7d101b2-76af-48ee-9777-dcbeaf9cfae7"). InnerVolumeSpecName "kube-api-access-ghhqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:18:44.177254 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.177231    2557 generic.go:356] "Generic (PLEG): container finished" podID="c7d101b2-76af-48ee-9777-dcbeaf9cfae7" containerID="156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13" exitCode=0
Jul 31 22:18:44.177355 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.177269    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"
Jul 31 22:18:44.177355 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.177298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w" event={"ID":"c7d101b2-76af-48ee-9777-dcbeaf9cfae7","Type":"ContainerDied","Data":"156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13"}
Jul 31 22:18:44.177355 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.177328    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w" event={"ID":"c7d101b2-76af-48ee-9777-dcbeaf9cfae7","Type":"ContainerDied","Data":"2397ed2f37ecf759eb59adab8953c7c8584ee9eed0647276fd79aaa07453bb22"}
Jul 31 22:18:44.177355 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.177345    2557 scope.go:117] "RemoveContainer" containerID="156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13"
Jul 31 22:18:44.185417 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.185399    2557 scope.go:117] "RemoveContainer" containerID="156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13"
Jul 31 22:18:44.185656 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:18:44.185636    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13\": container with ID starting with 156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13 not found: ID does not exist" containerID="156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13"
Jul 31 22:18:44.185705 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.185664    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13"} err="failed to get container status \"156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13\": rpc error: code = NotFound desc = could not find container \"156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13\": container with ID starting with 156df44987fcaa01c1a5ca6d38598ec0dc40cec7e1b592a234b6e2dced451b13 not found: ID does not exist"
Jul 31 22:18:44.196914 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.196892    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"]
Jul 31 22:18:44.200715 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.200694    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-0ac91e/test-model-0ac91e-kserve-598858fd99-5jw5w"]
Jul 31 22:18:44.231033 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.231008    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghhqt\" (UniqueName: \"kubernetes.io/projected/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-kube-api-access-ghhqt\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:44.231113 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.231034    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:44.231113 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.231048    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7d101b2-76af-48ee-9777-dcbeaf9cfae7-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:44.485769 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.485736    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d101b2-76af-48ee-9777-dcbeaf9cfae7" path="/var/lib/kubelet/pods/c7d101b2-76af-48ee-9777-dcbeaf9cfae7/volumes"
Jul 31 22:18:44.670706 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.670671    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx" podUID="c74ed20e-b791-4814-8632-8091c35d0098" containerName="main" containerID="cri-o://93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06" gracePeriod=45
Jul 31 22:18:44.906927 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:44.906905    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:18:45.036360 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036275    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-tmp-dir\") pod \"c74ed20e-b791-4814-8632-8091c35d0098\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") "
Jul 31 22:18:45.036360 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036328    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-dshm\") pod \"c74ed20e-b791-4814-8632-8091c35d0098\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") "
Jul 31 22:18:45.036360 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036351    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-home\") pod \"c74ed20e-b791-4814-8632-8091c35d0098\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") "
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036385    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74ed20e-b791-4814-8632-8091c35d0098-tls-certs\") pod \"c74ed20e-b791-4814-8632-8091c35d0098\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") "
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036413    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xkww\" (UniqueName: \"kubernetes.io/projected/c74ed20e-b791-4814-8632-8091c35d0098-kube-api-access-8xkww\") pod \"c74ed20e-b791-4814-8632-8091c35d0098\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") "
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036439    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-model-cache\") pod \"c74ed20e-b791-4814-8632-8091c35d0098\" (UID: \"c74ed20e-b791-4814-8632-8091c35d0098\") "
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036578    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c74ed20e-b791-4814-8632-8091c35d0098" (UID: "c74ed20e-b791-4814-8632-8091c35d0098"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036651    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-home" (OuterVolumeSpecName: "home") pod "c74ed20e-b791-4814-8632-8091c35d0098" (UID: "c74ed20e-b791-4814-8632-8091c35d0098"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036704    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:45.036837 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.036750    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-model-cache" (OuterVolumeSpecName: "model-cache") pod "c74ed20e-b791-4814-8632-8091c35d0098" (UID: "c74ed20e-b791-4814-8632-8091c35d0098"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:45.038579 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.038548    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74ed20e-b791-4814-8632-8091c35d0098-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c74ed20e-b791-4814-8632-8091c35d0098" (UID: "c74ed20e-b791-4814-8632-8091c35d0098"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:18:45.038696 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.038607    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-dshm" (OuterVolumeSpecName: "dshm") pod "c74ed20e-b791-4814-8632-8091c35d0098" (UID: "c74ed20e-b791-4814-8632-8091c35d0098"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:18:45.038696 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.038623    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74ed20e-b791-4814-8632-8091c35d0098-kube-api-access-8xkww" (OuterVolumeSpecName: "kube-api-access-8xkww") pod "c74ed20e-b791-4814-8632-8091c35d0098" (UID: "c74ed20e-b791-4814-8632-8091c35d0098"). InnerVolumeSpecName "kube-api-access-8xkww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:18:45.137223 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.137199    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:45.137223 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.137220    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:45.137360 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.137228    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c74ed20e-b791-4814-8632-8091c35d0098-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:45.137360 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.137237    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xkww\" (UniqueName: \"kubernetes.io/projected/c74ed20e-b791-4814-8632-8091c35d0098-kube-api-access-8xkww\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:45.137360 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.137246    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c74ed20e-b791-4814-8632-8091c35d0098-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:18:45.183198 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.183172    2557 generic.go:356] "Generic (PLEG): container finished" podID="c74ed20e-b791-4814-8632-8091c35d0098" containerID="93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06" exitCode=0
Jul 31 22:18:45.183318 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.183220    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"
Jul 31 22:18:45.183318 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.183242    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx" event={"ID":"c74ed20e-b791-4814-8632-8091c35d0098","Type":"ContainerDied","Data":"93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06"}
Jul 31 22:18:45.183318 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.183282    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx" event={"ID":"c74ed20e-b791-4814-8632-8091c35d0098","Type":"ContainerDied","Data":"f3b8c42f6b356e7e7373746f3741aec2f5794938e4184474d533a9d0f5df9dcb"}
Jul 31 22:18:45.183318 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.183304    2557 scope.go:117] "RemoveContainer" containerID="93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06"
Jul 31 22:18:45.193798 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.193767    2557 scope.go:117] "RemoveContainer" containerID="93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06"
Jul 31 22:18:45.194158 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:18:45.194098    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06\": container with ID starting with 93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06 not found: ID does not exist" containerID="93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06"
Jul 31 22:18:45.194158 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.194134    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06"} err="failed to get container status \"93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06\": rpc error: code = NotFound desc = could not find container \"93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06\": container with ID starting with 93645ce37d1dc7e22c3e2d9d87d91333ba61b509c3e5f084e53108b4c55cbf06 not found: ID does not exist"
Jul 31 22:18:45.205028 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.205010    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"]
Jul 31 22:18:45.209182 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:45.209161    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d0110c/test-model-d0110c-kserve-6765cf7dcf-f9sxx"]
Jul 31 22:18:46.485918 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:18:46.485883    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c74ed20e-b791-4814-8632-8091c35d0098" path="/var/lib/kubelet/pods/c74ed20e-b791-4814-8632-8091c35d0098/volumes"
Jul 31 22:19:00.128602 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:19:00.128559    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:19:12.625607 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:19:12.625571    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:19:42.018591 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:19:42.018520    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:20:23.519686 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:20:23.519651    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:20:45.668378 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:20:45.668344    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:20:57.826788 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:20:57.826757    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:21:14.534078 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:14.533997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:21:14.536738 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:14.536715    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:21:27.517585 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:27.517551    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:21:50.219796 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.219759    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"]
Jul 31 22:21:50.220269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.220072    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d101b2-76af-48ee-9777-dcbeaf9cfae7" containerName="main"
Jul 31 22:21:50.220269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.220084    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d101b2-76af-48ee-9777-dcbeaf9cfae7" containerName="main"
Jul 31 22:21:50.220269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.220093    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c74ed20e-b791-4814-8632-8091c35d0098" containerName="main"
Jul 31 22:21:50.220269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.220098    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c74ed20e-b791-4814-8632-8091c35d0098" containerName="main"
Jul 31 22:21:50.220269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.220151    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d101b2-76af-48ee-9777-dcbeaf9cfae7" containerName="main"
Jul 31 22:21:50.220269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.220158    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c74ed20e-b791-4814-8632-8091c35d0098" containerName="main"
Jul 31 22:21:50.223188 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.223172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.226533 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.226504    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"auth-test-model-ee9929-kserve-self-signed-certs\""
Jul 31 22:21:50.226664 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.226547    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"default-dockercfg-px6qf\""
Jul 31 22:21:50.226664 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.226607    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"openshift-service-ca.crt\""
Jul 31 22:21:50.226664 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.226625    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"kube-root-ca.crt\""
Jul 31 22:21:50.230992 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.230969    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"]
Jul 31 22:21:50.345588 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.345558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tls-certs\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.345756 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.345602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7dh\" (UniqueName: \"kubernetes.io/projected/2f09cf44-4d1c-479c-9496-c3eb46ac5845-kube-api-access-dw7dh\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.345756 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.345637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-model-cache\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.345756 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.345667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-home\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.345865 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.345771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tmp-dir\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.345865 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.345802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-dshm\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446345 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tmp-dir\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446345 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-dshm\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446564 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tls-certs\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446564 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7dh\" (UniqueName: \"kubernetes.io/projected/2f09cf44-4d1c-479c-9496-c3eb46ac5845-kube-api-access-dw7dh\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446564 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-model-cache\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446564 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446447    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-home\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446763 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tmp-dir\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446828 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-home\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.446886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.446824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-model-cache\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.448570 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.448552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-dshm\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.448938 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.448916    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tls-certs\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.454883 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.454859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7dh\" (UniqueName: \"kubernetes.io/projected/2f09cf44-4d1c-479c-9496-c3eb46ac5845-kube-api-access-dw7dh\") pod \"auth-test-model-ee9929-kserve-746c499d87-q4gt9\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") " pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.533160 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.533076    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:21:50.656450 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.656419    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"]
Jul 31 22:21:50.659063 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:21:50.659035    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f09cf44_4d1c_479c_9496_c3eb46ac5845.slice/crio-c1795842f34031ba9c8df98802780f55fddeedecd4dcd5a77b7bbf01bef94ccc WatchSource:0}: Error finding container c1795842f34031ba9c8df98802780f55fddeedecd4dcd5a77b7bbf01bef94ccc: Status 404 returned error can't find the container with id c1795842f34031ba9c8df98802780f55fddeedecd4dcd5a77b7bbf01bef94ccc
Jul 31 22:21:50.941014 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.940931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" event={"ID":"2f09cf44-4d1c-479c-9496-c3eb46ac5845","Type":"ContainerStarted","Data":"9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a"}
Jul 31 22:21:50.941014 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.940991    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" event={"ID":"2f09cf44-4d1c-479c-9496-c3eb46ac5845","Type":"ContainerStarted","Data":"c1795842f34031ba9c8df98802780f55fddeedecd4dcd5a77b7bbf01bef94ccc"}
Jul 31 22:21:50.957066 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:50.957023    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" podStartSLOduration=0.957008812 podStartE2EDuration="957.008812ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:21:50.956773678 +0000 UTC m=+2737.039782483" watchObservedRunningTime="2026-07-31 22:21:50.957008812 +0000 UTC m=+2737.040017664"
Jul 31 22:21:52.821097 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:21:52.821060    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:22:00.534144 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:00.534115    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:22:00.534474 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:00.534152    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:22:00.545842 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:00.545823    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:22:00.993394 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:00.993371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:22:20.215494 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.215459    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"]
Jul 31 22:22:20.218577 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.218562    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.221007 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.220981    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"default-dockercfg-zp5kt\""
Jul 31 22:22:20.221163 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.221009    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"auth-test-model-21e950-kserve-self-signed-certs\""
Jul 31 22:22:20.221163 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.221023    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"openshift-service-ca.crt\""
Jul 31 22:22:20.221163 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.221043    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"kube-root-ca.crt\""
Jul 31 22:22:20.226644 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.226614    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"]
Jul 31 22:22:20.275798 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.275766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-model-cache\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.275914 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.275823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add7f4d2-8f4c-4e31-81cc-afddda65964c-tls-certs\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.275914 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.275867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-tmp-dir\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.275914 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.275884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpn5\" (UniqueName: \"kubernetes.io/projected/add7f4d2-8f4c-4e31-81cc-afddda65964c-kube-api-access-2wpn5\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.275914 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.275901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-home\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.276078 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.275919    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-dshm\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376310 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add7f4d2-8f4c-4e31-81cc-afddda65964c-tls-certs\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376470 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-tmp-dir\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376470 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpn5\" (UniqueName: \"kubernetes.io/projected/add7f4d2-8f4c-4e31-81cc-afddda65964c-kube-api-access-2wpn5\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376470 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-home\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376470 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-dshm\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376686 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376558    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-model-cache\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376686 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-tmp-dir\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376793 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376723    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-home\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.376902 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.376878    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-model-cache\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.378767 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.378742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-dshm\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.378886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.378827    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add7f4d2-8f4c-4e31-81cc-afddda65964c-tls-certs\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.383898 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.383870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpn5\" (UniqueName: \"kubernetes.io/projected/add7f4d2-8f4c-4e31-81cc-afddda65964c-kube-api-access-2wpn5\") pod \"auth-test-model-21e950-kserve-777fcbff6c-v48rv\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") " pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.528550 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.528521    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:20.650448 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:20.650423    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"]
Jul 31 22:22:20.652905 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:22:20.652880    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadd7f4d2_8f4c_4e31_81cc_afddda65964c.slice/crio-dec08ac10ab3b48269653ec4a7d6943bd7f4ab6831fed03187226dd45415f36a WatchSource:0}: Error finding container dec08ac10ab3b48269653ec4a7d6943bd7f4ab6831fed03187226dd45415f36a: Status 404 returned error can't find the container with id dec08ac10ab3b48269653ec4a7d6943bd7f4ab6831fed03187226dd45415f36a
Jul 31 22:22:21.065412 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:21.065384    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv" event={"ID":"add7f4d2-8f4c-4e31-81cc-afddda65964c","Type":"ContainerStarted","Data":"661a72bbd27348be890fbc819e66e15ee96c6755f7ef73b72d41ece7d28de6b3"}
Jul 31 22:22:21.065558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:21.065421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv" event={"ID":"add7f4d2-8f4c-4e31-81cc-afddda65964c","Type":"ContainerStarted","Data":"dec08ac10ab3b48269653ec4a7d6943bd7f4ab6831fed03187226dd45415f36a"}
Jul 31 22:22:21.085152 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:21.085109    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv" podStartSLOduration=1.085097107 podStartE2EDuration="1.085097107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:22:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:22:21.084008484 +0000 UTC m=+2767.167017289" watchObservedRunningTime="2026-07-31 22:22:21.085097107 +0000 UTC m=+2767.168105910"
Jul 31 22:22:22.738308 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:22.738267    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:22:30.529128 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:30.529098    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:30.529128 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:30.529135    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:30.544703 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:30.544678    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:31.118004 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:31.117954    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:22:48.520599 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:22:48.520526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:04.031465 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:04.031429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:11.921855 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:11.921812    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:20.625880 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:20.625843    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:30.530561 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:30.530522    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:37.935040 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:37.935005    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:47.237381 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:47.237349    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:23:57.141978 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:23:57.141928    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:24:05.228661 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:24:05.228625    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:24:14.335831 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:24:14.335744    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:24:28.736629 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:24:28.736592    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:24:40.626765 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:24:40.626725    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:24:55.326021 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:24:55.325978    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:25:06.432067 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:06.432023    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:25:22.136899 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:22.136866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:25:25.904584 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:25.904548    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"]
Jul 31 22:25:26.720304 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:26.720273    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"]
Jul 31 22:25:32.027250 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:32.027217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:25:39.834667 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:39.834587    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:25:40.922695 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:40.922662    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" podUID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" containerName="main" containerID="cri-o://9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a" gracePeriod=45
Jul 31 22:25:40.983125 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:40.983084    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" podUID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" containerName="main" probeResult="failure" output="Get \"https://10.134.0.29:8000/ready\": dial tcp 10.134.0.29:8000: connect: connection refused"
Jul 31 22:25:41.170118 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.170089    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:25:41.320986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.320048    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tmp-dir\") pod \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") "
Jul 31 22:25:41.320986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.320108    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-dshm\") pod \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") "
Jul 31 22:25:41.320986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.320171    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tls-certs\") pod \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") "
Jul 31 22:25:41.320986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.320195    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-model-cache\") pod \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") "
Jul 31 22:25:41.320986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.320279    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-home\") pod \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") "
Jul 31 22:25:41.320986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.320322    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw7dh\" (UniqueName: \"kubernetes.io/projected/2f09cf44-4d1c-479c-9496-c3eb46ac5845-kube-api-access-dw7dh\") pod \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\" (UID: \"2f09cf44-4d1c-479c-9496-c3eb46ac5845\") "
Jul 31 22:25:41.324030 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.323754    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f09cf44-4d1c-479c-9496-c3eb46ac5845" (UID: "2f09cf44-4d1c-479c-9496-c3eb46ac5845"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:41.324868 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.324774    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f09cf44-4d1c-479c-9496-c3eb46ac5845" (UID: "2f09cf44-4d1c-479c-9496-c3eb46ac5845"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:41.324979 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.324905    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-home" (OuterVolumeSpecName: "home") pod "2f09cf44-4d1c-479c-9496-c3eb46ac5845" (UID: "2f09cf44-4d1c-479c-9496-c3eb46ac5845"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:41.326416 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.326347    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f09cf44-4d1c-479c-9496-c3eb46ac5845-kube-api-access-dw7dh" (OuterVolumeSpecName: "kube-api-access-dw7dh") pod "2f09cf44-4d1c-479c-9496-c3eb46ac5845" (UID: "2f09cf44-4d1c-479c-9496-c3eb46ac5845"). InnerVolumeSpecName "kube-api-access-dw7dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:25:41.326641 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.326615    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-dshm" (OuterVolumeSpecName: "dshm") pod "2f09cf44-4d1c-479c-9496-c3eb46ac5845" (UID: "2f09cf44-4d1c-479c-9496-c3eb46ac5845"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:41.326740 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.326723    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f09cf44-4d1c-479c-9496-c3eb46ac5845" (UID: "2f09cf44-4d1c-479c-9496-c3eb46ac5845"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:25:41.421197 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.421175    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:41.421197 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.421197    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw7dh\" (UniqueName: \"kubernetes.io/projected/2f09cf44-4d1c-479c-9496-c3eb46ac5845-kube-api-access-dw7dh\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:41.421340 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.421207    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:41.421340 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.421216    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:41.421340 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.421224    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f09cf44-4d1c-479c-9496-c3eb46ac5845-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:41.421340 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.421231    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f09cf44-4d1c-479c-9496-c3eb46ac5845-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:41.740437 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.740380    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv" podUID="add7f4d2-8f4c-4e31-81cc-afddda65964c" containerName="main" containerID="cri-o://661a72bbd27348be890fbc819e66e15ee96c6755f7ef73b72d41ece7d28de6b3" gracePeriod=45
Jul 31 22:25:41.925479 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.925449    2557 generic.go:356] "Generic (PLEG): container finished" podID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" containerID="9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a" exitCode=0
Jul 31 22:25:41.925886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.925526    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"
Jul 31 22:25:41.925886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.925529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" event={"ID":"2f09cf44-4d1c-479c-9496-c3eb46ac5845","Type":"ContainerDied","Data":"9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a"}
Jul 31 22:25:41.925886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.925579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9" event={"ID":"2f09cf44-4d1c-479c-9496-c3eb46ac5845","Type":"ContainerDied","Data":"c1795842f34031ba9c8df98802780f55fddeedecd4dcd5a77b7bbf01bef94ccc"}
Jul 31 22:25:41.925886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.925608    2557 scope.go:117] "RemoveContainer" containerID="9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a"
Jul 31 22:25:41.927272 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.927251    2557 generic.go:356] "Generic (PLEG): container finished" podID="add7f4d2-8f4c-4e31-81cc-afddda65964c" containerID="661a72bbd27348be890fbc819e66e15ee96c6755f7ef73b72d41ece7d28de6b3" exitCode=0
Jul 31 22:25:41.927381 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.927326    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv" event={"ID":"add7f4d2-8f4c-4e31-81cc-afddda65964c","Type":"ContainerDied","Data":"661a72bbd27348be890fbc819e66e15ee96c6755f7ef73b72d41ece7d28de6b3"}
Jul 31 22:25:41.940209 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.940190    2557 scope.go:117] "RemoveContainer" containerID="9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a"
Jul 31 22:25:41.940443 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:25:41.940427    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a\": container with ID starting with 9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a not found: ID does not exist" containerID="9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a"
Jul 31 22:25:41.940491 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.940450    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a"} err="failed to get container status \"9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a\": rpc error: code = NotFound desc = could not find container \"9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a\": container with ID starting with 9d5cf66c59af6ecfbeeac6bf72a88811aa74f8cf0fe8603a5d52fc8b64f13e4a not found: ID does not exist"
Jul 31 22:25:41.952862 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.952838    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"]
Jul 31 22:25:41.954840 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.954818    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/auth-test-model-ee9929-kserve-746c499d87-q4gt9"]
Jul 31 22:25:41.983646 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:41.983624    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:25:42.126075 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126008    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-model-cache\") pod \"add7f4d2-8f4c-4e31-81cc-afddda65964c\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") "
Jul 31 22:25:42.126075 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126046    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add7f4d2-8f4c-4e31-81cc-afddda65964c-tls-certs\") pod \"add7f4d2-8f4c-4e31-81cc-afddda65964c\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") "
Jul 31 22:25:42.126075 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126069    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-dshm\") pod \"add7f4d2-8f4c-4e31-81cc-afddda65964c\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") "
Jul 31 22:25:42.126299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126139    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-tmp-dir\") pod \"add7f4d2-8f4c-4e31-81cc-afddda65964c\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") "
Jul 31 22:25:42.126299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126174    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-home\") pod \"add7f4d2-8f4c-4e31-81cc-afddda65964c\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") "
Jul 31 22:25:42.126299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126206    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wpn5\" (UniqueName: \"kubernetes.io/projected/add7f4d2-8f4c-4e31-81cc-afddda65964c-kube-api-access-2wpn5\") pod \"add7f4d2-8f4c-4e31-81cc-afddda65964c\" (UID: \"add7f4d2-8f4c-4e31-81cc-afddda65964c\") "
Jul 31 22:25:42.126299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126242    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-model-cache" (OuterVolumeSpecName: "model-cache") pod "add7f4d2-8f4c-4e31-81cc-afddda65964c" (UID: "add7f4d2-8f4c-4e31-81cc-afddda65964c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:42.126478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126415    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:42.126478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126418    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "add7f4d2-8f4c-4e31-81cc-afddda65964c" (UID: "add7f4d2-8f4c-4e31-81cc-afddda65964c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:42.126478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.126459    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-home" (OuterVolumeSpecName: "home") pod "add7f4d2-8f4c-4e31-81cc-afddda65964c" (UID: "add7f4d2-8f4c-4e31-81cc-afddda65964c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:42.128272 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.128243    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add7f4d2-8f4c-4e31-81cc-afddda65964c-kube-api-access-2wpn5" (OuterVolumeSpecName: "kube-api-access-2wpn5") pod "add7f4d2-8f4c-4e31-81cc-afddda65964c" (UID: "add7f4d2-8f4c-4e31-81cc-afddda65964c"). InnerVolumeSpecName "kube-api-access-2wpn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:25:42.128363 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.128293    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-dshm" (OuterVolumeSpecName: "dshm") pod "add7f4d2-8f4c-4e31-81cc-afddda65964c" (UID: "add7f4d2-8f4c-4e31-81cc-afddda65964c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:25:42.128363 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.128298    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/add7f4d2-8f4c-4e31-81cc-afddda65964c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "add7f4d2-8f4c-4e31-81cc-afddda65964c" (UID: "add7f4d2-8f4c-4e31-81cc-afddda65964c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:25:42.227371 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.227346    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:42.227371 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.227367    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wpn5\" (UniqueName: \"kubernetes.io/projected/add7f4d2-8f4c-4e31-81cc-afddda65964c-kube-api-access-2wpn5\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:42.227511 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.227378    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add7f4d2-8f4c-4e31-81cc-afddda65964c-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:42.227511 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.227386    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:42.227511 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.227394    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add7f4d2-8f4c-4e31-81cc-afddda65964c-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:25:42.487110 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.487079    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" path="/var/lib/kubelet/pods/2f09cf44-4d1c-479c-9496-c3eb46ac5845/volumes"
Jul 31 22:25:42.933899 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.933812    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"
Jul 31 22:25:42.933899 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.933861    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv" event={"ID":"add7f4d2-8f4c-4e31-81cc-afddda65964c","Type":"ContainerDied","Data":"dec08ac10ab3b48269653ec4a7d6943bd7f4ab6831fed03187226dd45415f36a"}
Jul 31 22:25:42.934440 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.933924    2557 scope.go:117] "RemoveContainer" containerID="661a72bbd27348be890fbc819e66e15ee96c6755f7ef73b72d41ece7d28de6b3"
Jul 31 22:25:42.952521 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.952496    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"]
Jul 31 22:25:42.958401 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:42.958377    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/auth-test-model-21e950-kserve-777fcbff6c-v48rv"]
Jul 31 22:25:44.486454 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:25:44.486421    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add7f4d2-8f4c-4e31-81cc-afddda65964c" path="/var/lib/kubelet/pods/add7f4d2-8f4c-4e31-81cc-afddda65964c/volumes"
Jul 31 22:26:14.556049 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:14.556022    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:26:14.560333 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:14.560314    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:26:20.523333 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523302    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"]
Jul 31 22:26:20.523787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523577    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" containerName="main"
Jul 31 22:26:20.523787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523587    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" containerName="main"
Jul 31 22:26:20.523787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523597    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add7f4d2-8f4c-4e31-81cc-afddda65964c" containerName="main"
Jul 31 22:26:20.523787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523602    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="add7f4d2-8f4c-4e31-81cc-afddda65964c" containerName="main"
Jul 31 22:26:20.523787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523652    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f09cf44-4d1c-479c-9496-c3eb46ac5845" containerName="main"
Jul 31 22:26:20.523787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.523658    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="add7f4d2-8f4c-4e31-81cc-afddda65964c" containerName="main"
Jul 31 22:26:20.527704 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.527688    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.531840 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.531813    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"kube-root-ca.crt\""
Jul 31 22:26:20.531986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.531815    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"openshift-service-ca.crt\""
Jul 31 22:26:20.531986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.531855    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"default-dockercfg-zp5kt\""
Jul 31 22:26:20.531986 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.531891    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"sub-test-model-21e950-kserve-self-signed-certs\""
Jul 31 22:26:20.535339 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.535317    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"]
Jul 31 22:26:20.592410 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.592385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-model-cache\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.592524 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.592419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhssw\" (UniqueName: \"kubernetes.io/projected/6c4921a5-01fa-4595-9813-37ce999b1e4e-kube-api-access-xhssw\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.592524 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.592456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4921a5-01fa-4595-9813-37ce999b1e4e-tls-certs\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.592524 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.592489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-tmp-dir\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.592524 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.592511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-home\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.592656 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.592531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-dshm\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693251 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-model-cache\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693368 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhssw\" (UniqueName: \"kubernetes.io/projected/6c4921a5-01fa-4595-9813-37ce999b1e4e-kube-api-access-xhssw\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693368 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4921a5-01fa-4595-9813-37ce999b1e4e-tls-certs\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693368 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-tmp-dir\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693368 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693346    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-home\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693368 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-dshm\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693719 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-model-cache\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693818 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693741    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-tmp-dir\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.693818 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.693769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-home\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.695490 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.695471    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-dshm\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.695856 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.695837    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4921a5-01fa-4595-9813-37ce999b1e4e-tls-certs\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.702343 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.702321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhssw\" (UniqueName: \"kubernetes.io/projected/6c4921a5-01fa-4595-9813-37ce999b1e4e-kube-api-access-xhssw\") pod \"sub-test-model-21e950-kserve-6596db4b7-zg5dm\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") " pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.837423 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.837353    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:20.960253 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:20.960229    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"]
Jul 31 22:26:20.962537 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:26:20.962499    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c4921a5_01fa_4595_9813_37ce999b1e4e.slice/crio-9a3be3ff43efb791892b7348d3052db2aa7fa3fc77cb1d81cc1b6a6128153229 WatchSource:0}: Error finding container 9a3be3ff43efb791892b7348d3052db2aa7fa3fc77cb1d81cc1b6a6128153229: Status 404 returned error can't find the container with id 9a3be3ff43efb791892b7348d3052db2aa7fa3fc77cb1d81cc1b6a6128153229
Jul 31 22:26:21.097126 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:21.097042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm" event={"ID":"6c4921a5-01fa-4595-9813-37ce999b1e4e","Type":"ContainerStarted","Data":"28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195"}
Jul 31 22:26:21.097126 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:21.097093    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm" event={"ID":"6c4921a5-01fa-4595-9813-37ce999b1e4e","Type":"ContainerStarted","Data":"9a3be3ff43efb791892b7348d3052db2aa7fa3fc77cb1d81cc1b6a6128153229"}
Jul 31 22:26:23.134987 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:23.131144    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm" podStartSLOduration=3.131126253 podStartE2EDuration="3.131126253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:26:21.12933314 +0000 UTC m=+3007.212341943" watchObservedRunningTime="2026-07-31 22:26:23.131126253 +0000 UTC m=+3009.214135058"
Jul 31 22:26:23.134987 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:23.133996    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:26:30.838259 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:30.838221    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:30.838643 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:30.838290    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:30.850696 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:30.850668    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:31.151513 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:31.151436    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:26:59.527558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:26:59.527526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:27:12.637472 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:12.637395    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:27:24.336977 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:24.336937    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:27:31.096452 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:31.096421    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"]
Jul 31 22:27:33.738417 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:33.738379    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:27:39.126938 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.126902    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"]
Jul 31 22:27:39.129813 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.129798    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.132851 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.132826    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"openshift-service-ca.crt\""
Jul 31 22:27:39.133935 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.133915    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"rate-test-model-ee9929-kserve-self-signed-certs\""
Jul 31 22:27:39.134074 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.133943    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"default-dockercfg-px6qf\""
Jul 31 22:27:39.134074 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.133942    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ee9929\"/\"kube-root-ca.crt\""
Jul 31 22:27:39.146461 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.146437    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"]
Jul 31 22:27:39.176416 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.176393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-home\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.176516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.176419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/672207ef-e82c-46fd-a4ef-42c93897d3e8-tls-certs\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.176516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.176467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-model-cache\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.176516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.176486    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-dshm\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.176516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.176500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-tmp-dir\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.176665 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.176525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kj6w\" (UniqueName: \"kubernetes.io/projected/672207ef-e82c-46fd-a4ef-42c93897d3e8-kube-api-access-6kj6w\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277568 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-model-cache\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277666 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-dshm\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277666 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-tmp-dir\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277807 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kj6w\" (UniqueName: \"kubernetes.io/projected/672207ef-e82c-46fd-a4ef-42c93897d3e8-kube-api-access-6kj6w\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277891 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-home\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277891 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277847    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/672207ef-e82c-46fd-a4ef-42c93897d3e8-tls-certs\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.277891 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.277868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-tmp-dir\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.278083 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.278055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-model-cache\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.278171 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.278151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-home\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.279740 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.279717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-dshm\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.280276 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.280256    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/672207ef-e82c-46fd-a4ef-42c93897d3e8-tls-certs\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.287346 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.287324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kj6w\" (UniqueName: \"kubernetes.io/projected/672207ef-e82c-46fd-a4ef-42c93897d3e8-kube-api-access-6kj6w\") pod \"rate-test-model-ee9929-kserve-7d949d586c-vz49c\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") " pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.438616 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.438536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:39.572896 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:39.572865    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"]
Jul 31 22:27:39.575019 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:27:39.574988    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod672207ef_e82c_46fd_a4ef_42c93897d3e8.slice/crio-fd9d481ad39a4cb70c6d370f6a76d2777adee348349d2c3f34e956b2746288c0 WatchSource:0}: Error finding container fd9d481ad39a4cb70c6d370f6a76d2777adee348349d2c3f34e956b2746288c0: Status 404 returned error can't find the container with id fd9d481ad39a4cb70c6d370f6a76d2777adee348349d2c3f34e956b2746288c0
Jul 31 22:27:40.438609 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:40.438575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c" event={"ID":"672207ef-e82c-46fd-a4ef-42c93897d3e8","Type":"ContainerStarted","Data":"5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8"}
Jul 31 22:27:40.438609 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:40.438615    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c" event={"ID":"672207ef-e82c-46fd-a4ef-42c93897d3e8","Type":"ContainerStarted","Data":"fd9d481ad39a4cb70c6d370f6a76d2777adee348349d2c3f34e956b2746288c0"}
Jul 31 22:27:40.456994 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:40.456892    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c" podStartSLOduration=1.45687933 podStartE2EDuration="1.45687933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:27:40.454747152 +0000 UTC m=+3086.537755956" watchObservedRunningTime="2026-07-31 22:27:40.45687933 +0000 UTC m=+3086.539888157"
Jul 31 22:27:40.726294 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:40.726266    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:27:46.115274 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.115208    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm" podUID="6c4921a5-01fa-4595-9813-37ce999b1e4e" containerName="main" containerID="cri-o://28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195" gracePeriod=45
Jul 31 22:27:46.351866 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.351835    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:27:46.439324 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439235    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-tmp-dir\") pod \"6c4921a5-01fa-4595-9813-37ce999b1e4e\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") "
Jul 31 22:27:46.439324 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439280    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-model-cache\") pod \"6c4921a5-01fa-4595-9813-37ce999b1e4e\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") "
Jul 31 22:27:46.439556 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439336    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhssw\" (UniqueName: \"kubernetes.io/projected/6c4921a5-01fa-4595-9813-37ce999b1e4e-kube-api-access-xhssw\") pod \"6c4921a5-01fa-4595-9813-37ce999b1e4e\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") "
Jul 31 22:27:46.439556 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439382    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-dshm\") pod \"6c4921a5-01fa-4595-9813-37ce999b1e4e\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") "
Jul 31 22:27:46.439556 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439405    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-home\") pod \"6c4921a5-01fa-4595-9813-37ce999b1e4e\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") "
Jul 31 22:27:46.439556 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439424    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4921a5-01fa-4595-9813-37ce999b1e4e-tls-certs\") pod \"6c4921a5-01fa-4595-9813-37ce999b1e4e\" (UID: \"6c4921a5-01fa-4595-9813-37ce999b1e4e\") "
Jul 31 22:27:46.439756 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439568    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c4921a5-01fa-4595-9813-37ce999b1e4e" (UID: "6c4921a5-01fa-4595-9813-37ce999b1e4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:27:46.439756 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439643    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c4921a5-01fa-4595-9813-37ce999b1e4e" (UID: "6c4921a5-01fa-4595-9813-37ce999b1e4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:27:46.439756 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.439653    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-home" (OuterVolumeSpecName: "home") pod "6c4921a5-01fa-4595-9813-37ce999b1e4e" (UID: "6c4921a5-01fa-4595-9813-37ce999b1e4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:27:46.441521 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.441489    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4921a5-01fa-4595-9813-37ce999b1e4e-kube-api-access-xhssw" (OuterVolumeSpecName: "kube-api-access-xhssw") pod "6c4921a5-01fa-4595-9813-37ce999b1e4e" (UID: "6c4921a5-01fa-4595-9813-37ce999b1e4e"). InnerVolumeSpecName "kube-api-access-xhssw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:27:46.441521 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.441508    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-dshm" (OuterVolumeSpecName: "dshm") pod "6c4921a5-01fa-4595-9813-37ce999b1e4e" (UID: "6c4921a5-01fa-4595-9813-37ce999b1e4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:27:46.441660 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.441520    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4921a5-01fa-4595-9813-37ce999b1e4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c4921a5-01fa-4595-9813-37ce999b1e4e" (UID: "6c4921a5-01fa-4595-9813-37ce999b1e4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:27:46.466235 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.466205    2557 generic.go:356] "Generic (PLEG): container finished" podID="6c4921a5-01fa-4595-9813-37ce999b1e4e" containerID="28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195" exitCode=0
Jul 31 22:27:46.466362 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.466250    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"
Jul 31 22:27:46.466362 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.466291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm" event={"ID":"6c4921a5-01fa-4595-9813-37ce999b1e4e","Type":"ContainerDied","Data":"28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195"}
Jul 31 22:27:46.466362 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.466346    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm" event={"ID":"6c4921a5-01fa-4595-9813-37ce999b1e4e","Type":"ContainerDied","Data":"9a3be3ff43efb791892b7348d3052db2aa7fa3fc77cb1d81cc1b6a6128153229"}
Jul 31 22:27:46.466518 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.466371    2557 scope.go:117] "RemoveContainer" containerID="28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195"
Jul 31 22:27:46.474913 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.474895    2557 scope.go:117] "RemoveContainer" containerID="28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195"
Jul 31 22:27:46.475183 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:27:46.475160    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195\": container with ID starting with 28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195 not found: ID does not exist" containerID="28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195"
Jul 31 22:27:46.475245 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.475191    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195"} err="failed to get container status \"28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195\": rpc error: code = NotFound desc = could not find container \"28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195\": container with ID starting with 28ab5d81dd66ffeba24a765b333ecc7ec1521b249589e4b7329ae69cb16b4195 not found: ID does not exist"
Jul 31 22:27:46.488276 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.488253    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"]
Jul 31 22:27:46.492320 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.492299    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/sub-test-model-21e950-kserve-6596db4b7-zg5dm"]
Jul 31 22:27:46.540505 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.540473    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhssw\" (UniqueName: \"kubernetes.io/projected/6c4921a5-01fa-4595-9813-37ce999b1e4e-kube-api-access-xhssw\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:27:46.540505 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.540500    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:27:46.540505 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.540512    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:27:46.540723 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.540520    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c4921a5-01fa-4595-9813-37ce999b1e4e-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:27:46.540723 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.540530    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:27:46.540723 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:46.540539    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c4921a5-01fa-4595-9813-37ce999b1e4e-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:27:48.486100 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:48.486070    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c4921a5-01fa-4595-9813-37ce999b1e4e" path="/var/lib/kubelet/pods/6c4921a5-01fa-4595-9813-37ce999b1e4e/volumes"
Jul 31 22:27:49.439741 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:49.439705    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:49.439741 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:49.439749    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:49.452121 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:49.452088    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:27:49.491915 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:27:49.491880    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:28:19.629766 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.629735    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"]
Jul 31 22:28:19.630180 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.630049    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4921a5-01fa-4595-9813-37ce999b1e4e" containerName="main"
Jul 31 22:28:19.630180 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.630061    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4921a5-01fa-4595-9813-37ce999b1e4e" containerName="main"
Jul 31 22:28:19.630180 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.630128    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c4921a5-01fa-4595-9813-37ce999b1e4e" containerName="main"
Jul 31 22:28:19.634061 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.634045    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.637369 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.637347    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"openshift-service-ca.crt\""
Jul 31 22:28:19.637369 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.637360    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"rate-test-model-21e950-kserve-self-signed-certs\""
Jul 31 22:28:19.638672 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.638654    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"kube-root-ca.crt\""
Jul 31 22:28:19.638736 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.638684    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-21e950\"/\"default-dockercfg-zp5kt\""
Jul 31 22:28:19.644411 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.644393    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"]
Jul 31 22:28:19.807553 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.807511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-home\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.807752 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.807653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tmp-dir\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.807752 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.807693    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-dshm\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.807752 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.807724    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-model-cache\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.807752 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.807748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tls-certs\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.807923 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.807776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lx85\" (UniqueName: \"kubernetes.io/projected/d42e4d13-6bdd-48e7-8be4-43e861237ce7-kube-api-access-9lx85\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908305 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tls-certs\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908305 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lx85\" (UniqueName: \"kubernetes.io/projected/d42e4d13-6bdd-48e7-8be4-43e861237ce7-kube-api-access-9lx85\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908305 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-home\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908592 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908371    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tmp-dir\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908592 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-dshm\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908592 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-model-cache\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908748 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-home\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908793 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908777    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-model-cache\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.908848 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.908819    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tmp-dir\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.910646 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.910627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-dshm\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.910944 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.910922    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tls-certs\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.917826 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.917801    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lx85\" (UniqueName: \"kubernetes.io/projected/d42e4d13-6bdd-48e7-8be4-43e861237ce7-kube-api-access-9lx85\") pod \"rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") " pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:19.943635 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:19.943599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:20.075359 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:20.075325    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"]
Jul 31 22:28:20.078173 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:28:20.078141    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd42e4d13_6bdd_48e7_8be4_43e861237ce7.slice/crio-bd58dd958819298023aff53bf1c65398e0eb754100e54dfe4936f434abc0127b WatchSource:0}: Error finding container bd58dd958819298023aff53bf1c65398e0eb754100e54dfe4936f434abc0127b: Status 404 returned error can't find the container with id bd58dd958819298023aff53bf1c65398e0eb754100e54dfe4936f434abc0127b
Jul 31 22:28:20.617712 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:20.617678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx" event={"ID":"d42e4d13-6bdd-48e7-8be4-43e861237ce7","Type":"ContainerStarted","Data":"7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110"}
Jul 31 22:28:20.617877 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:20.617725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx" event={"ID":"d42e4d13-6bdd-48e7-8be4-43e861237ce7","Type":"ContainerStarted","Data":"bd58dd958819298023aff53bf1c65398e0eb754100e54dfe4936f434abc0127b"}
Jul 31 22:28:20.639087 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:20.639038    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx" podStartSLOduration=1.639023028 podStartE2EDuration="1.639023028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:20.637208528 +0000 UTC m=+3126.720217334" watchObservedRunningTime="2026-07-31 22:28:20.639023028 +0000 UTC m=+3126.722031832"
Jul 31 22:28:22.148104 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:22.148068    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:28:29.944177 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:29.944119    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:29.944698 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:29.944195    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:29.956699 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:29.956661    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:30.679696 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:30.679664    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:28:58.540733 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:28:58.540697    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:29:06.341107 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:06.341070    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:29:23.128580 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:23.128541    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:29:28.736510 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:28.736477    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"]
Jul 31 22:29:29.735035 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:29.734998    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"]
Jul 31 22:29:30.719858 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.719830    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7527-140539711895984"]
Jul 31 22:29:30.722851 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.722833    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:30.725809 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.725786    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kc9s9\""
Jul 31 22:29:30.729388 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.729362    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711895984"]
Jul 31 22:29:30.834179 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.834154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8khz\" (UniqueName: \"kubernetes.io/projected/85fc9d2a-83f4-46b8-925f-81cd19d493b9-kube-api-access-r8khz\") pod \"test-curl-7527-140539711895984\" (UID: \"85fc9d2a-83f4-46b8-925f-81cd19d493b9\") " pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:30.934504 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.934474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8khz\" (UniqueName: \"kubernetes.io/projected/85fc9d2a-83f4-46b8-925f-81cd19d493b9-kube-api-access-r8khz\") pod \"test-curl-7527-140539711895984\" (UID: \"85fc9d2a-83f4-46b8-925f-81cd19d493b9\") " pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:30.943291 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:30.943268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8khz\" (UniqueName: \"kubernetes.io/projected/85fc9d2a-83f4-46b8-925f-81cd19d493b9-kube-api-access-r8khz\") pod \"test-curl-7527-140539711895984\" (UID: \"85fc9d2a-83f4-46b8-925f-81cd19d493b9\") " pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:31.033461 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:31.033409    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:31.161119 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:31.161095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711895984"]
Jul 31 22:29:31.162845 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:29:31.162812    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85fc9d2a_83f4_46b8_925f_81cd19d493b9.slice/crio-83bf7b3f1c0e4b40474502c3601aff0f5de83b28a7a97cd2897654c1ee6ea8d9 WatchSource:0}: Error finding container 83bf7b3f1c0e4b40474502c3601aff0f5de83b28a7a97cd2897654c1ee6ea8d9: Status 404 returned error can't find the container with id 83bf7b3f1c0e4b40474502c3601aff0f5de83b28a7a97cd2897654c1ee6ea8d9
Jul 31 22:29:31.164162 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:31.164144    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:29:31.941492 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:31.941468    2557 generic.go:356] "Generic (PLEG): container finished" podID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" containerID="aac9ad8145eb5750acf3683dc554b2918fca8fe0e2c9c7d3ddc6604e315e393f" exitCode=0
Jul 31 22:29:31.941797 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:31.941551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711895984" event={"ID":"85fc9d2a-83f4-46b8-925f-81cd19d493b9","Type":"ContainerDied","Data":"aac9ad8145eb5750acf3683dc554b2918fca8fe0e2c9c7d3ddc6604e315e393f"}
Jul 31 22:29:31.941797 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:31.941604    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711895984" event={"ID":"85fc9d2a-83f4-46b8-925f-81cd19d493b9","Type":"ContainerStarted","Data":"83bf7b3f1c0e4b40474502c3601aff0f5de83b28a7a97cd2897654c1ee6ea8d9"}
Jul 31 22:29:32.233338 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:32.233311    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:29:33.083138 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.083110    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:33.122908 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.122876    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7527-140539711895984_85fc9d2a-83f4-46b8-925f-81cd19d493b9/test-curl-7527-140539711895984/0.log"
Jul 31 22:29:33.148972 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.148940    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7527-140539711895984"]
Jul 31 22:29:33.153072 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.153050    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7527-140539711895984"]
Jul 31 22:29:33.155884 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.155866    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8khz\" (UniqueName: \"kubernetes.io/projected/85fc9d2a-83f4-46b8-925f-81cd19d493b9-kube-api-access-r8khz\") pod \"85fc9d2a-83f4-46b8-925f-81cd19d493b9\" (UID: \"85fc9d2a-83f4-46b8-925f-81cd19d493b9\") "
Jul 31 22:29:33.158308 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.158274    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85fc9d2a-83f4-46b8-925f-81cd19d493b9-kube-api-access-r8khz" (OuterVolumeSpecName: "kube-api-access-r8khz") pod "85fc9d2a-83f4-46b8-925f-81cd19d493b9" (UID: "85fc9d2a-83f4-46b8-925f-81cd19d493b9"). InnerVolumeSpecName "kube-api-access-r8khz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:33.256947 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.256920    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8khz\" (UniqueName: \"kubernetes.io/projected/85fc9d2a-83f4-46b8-925f-81cd19d493b9-kube-api-access-r8khz\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:33.288711 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.288678    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7527-140539711951664"]
Jul 31 22:29:33.289028 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.289014    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" containerName="test-curl-7527-140539711895984"
Jul 31 22:29:33.289028 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.289029    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" containerName="test-curl-7527-140539711895984"
Jul 31 22:29:33.289122 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.289088    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" containerName="test-curl-7527-140539711895984"
Jul 31 22:29:33.291854 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.291839    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:33.298463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.298438    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711951664"]
Jul 31 22:29:33.357475 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.357445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7cf\" (UniqueName: \"kubernetes.io/projected/7ad14d7d-11f9-4015-8abb-77c119fee14e-kube-api-access-pt7cf\") pod \"test-curl-7527-140539711951664\" (UID: \"7ad14d7d-11f9-4015-8abb-77c119fee14e\") " pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:33.458263 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.458228    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7cf\" (UniqueName: \"kubernetes.io/projected/7ad14d7d-11f9-4015-8abb-77c119fee14e-kube-api-access-pt7cf\") pod \"test-curl-7527-140539711951664\" (UID: \"7ad14d7d-11f9-4015-8abb-77c119fee14e\") " pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:33.467569 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.467533    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7cf\" (UniqueName: \"kubernetes.io/projected/7ad14d7d-11f9-4015-8abb-77c119fee14e-kube-api-access-pt7cf\") pod \"test-curl-7527-140539711951664\" (UID: \"7ad14d7d-11f9-4015-8abb-77c119fee14e\") " pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:33.602185 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.602099    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:33.730127 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.730054    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711951664"]
Jul 31 22:29:33.732112 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:29:33.732087    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ad14d7d_11f9_4015_8abb_77c119fee14e.slice/crio-fc062e02addde74b6f0ee39c5f31a52f7d38be9e05309d91e925378d4885afb7 WatchSource:0}: Error finding container fc062e02addde74b6f0ee39c5f31a52f7d38be9e05309d91e925378d4885afb7: Status 404 returned error can't find the container with id fc062e02addde74b6f0ee39c5f31a52f7d38be9e05309d91e925378d4885afb7
Jul 31 22:29:33.954043 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.953952    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:33.954191 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.953952    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83bf7b3f1c0e4b40474502c3601aff0f5de83b28a7a97cd2897654c1ee6ea8d9"
Jul 31 22:29:33.955073 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:33.955049    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711951664" event={"ID":"7ad14d7d-11f9-4015-8abb-77c119fee14e","Type":"ContainerStarted","Data":"fc062e02addde74b6f0ee39c5f31a52f7d38be9e05309d91e925378d4885afb7"}
Jul 31 22:29:33.965219 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:29:33.965195    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7527-140539711895984\" is forbidden: User \"system:node:ip-10-0-142-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-220.ec2.internal' and this object" podUID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:34.484913 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:29:34.484877    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7527-140539711895984\" is forbidden: User \"system:node:ip-10-0-142-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-220.ec2.internal' and this object" podUID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" pod="opendatahub/test-curl-7527-140539711895984"
Jul 31 22:29:34.486426 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:34.486404    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85fc9d2a-83f4-46b8-925f-81cd19d493b9" path="/var/lib/kubelet/pods/85fc9d2a-83f4-46b8-925f-81cd19d493b9/volumes"
Jul 31 22:29:34.961318 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:34.961226    2557 generic.go:356] "Generic (PLEG): container finished" podID="7ad14d7d-11f9-4015-8abb-77c119fee14e" containerID="7d8e1bb30d71bf802f217d9a046d385f575650d90ca837b3945be611e97b339a" exitCode=0
Jul 31 22:29:34.961459 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:34.961319    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711951664" event={"ID":"7ad14d7d-11f9-4015-8abb-77c119fee14e","Type":"ContainerDied","Data":"7d8e1bb30d71bf802f217d9a046d385f575650d90ca837b3945be611e97b339a"}
Jul 31 22:29:36.100791 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.100757    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:36.122718 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.122683    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7527-140539711951664_7ad14d7d-11f9-4015-8abb-77c119fee14e/test-curl-7527-140539711951664/0.log"
Jul 31 22:29:36.149773 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.149734    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7527-140539711951664"]
Jul 31 22:29:36.151509 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.151478    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7527-140539711951664"]
Jul 31 22:29:36.181385 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.181350    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt7cf\" (UniqueName: \"kubernetes.io/projected/7ad14d7d-11f9-4015-8abb-77c119fee14e-kube-api-access-pt7cf\") pod \"7ad14d7d-11f9-4015-8abb-77c119fee14e\" (UID: \"7ad14d7d-11f9-4015-8abb-77c119fee14e\") "
Jul 31 22:29:36.183534 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.183497    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad14d7d-11f9-4015-8abb-77c119fee14e-kube-api-access-pt7cf" (OuterVolumeSpecName: "kube-api-access-pt7cf") pod "7ad14d7d-11f9-4015-8abb-77c119fee14e" (UID: "7ad14d7d-11f9-4015-8abb-77c119fee14e"). InnerVolumeSpecName "kube-api-access-pt7cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:36.282326 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.282288    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt7cf\" (UniqueName: \"kubernetes.io/projected/7ad14d7d-11f9-4015-8abb-77c119fee14e-kube-api-access-pt7cf\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:36.486386 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.486352    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad14d7d-11f9-4015-8abb-77c119fee14e" path="/var/lib/kubelet/pods/7ad14d7d-11f9-4015-8abb-77c119fee14e/volumes"
Jul 31 22:29:36.970456 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.970424    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711951664"
Jul 31 22:29:36.970456 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:36.970448    2557 scope.go:117] "RemoveContainer" containerID="7d8e1bb30d71bf802f217d9a046d385f575650d90ca837b3945be611e97b339a"
Jul 31 22:29:42.240087 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.240054    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:42.240475 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.240358    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad14d7d-11f9-4015-8abb-77c119fee14e" containerName="test-curl-7527-140539711951664"
Jul 31 22:29:42.240475 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.240369    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad14d7d-11f9-4015-8abb-77c119fee14e" containerName="test-curl-7527-140539711951664"
Jul 31 22:29:42.240475 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.240427    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad14d7d-11f9-4015-8abb-77c119fee14e" containerName="test-curl-7527-140539711951664"
Jul 31 22:29:42.244579 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.244561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:42.247836 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.247817    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kc9s9\""
Jul 31 22:29:42.251824 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.251791    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:42.332761 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.332733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bn5\" (UniqueName: \"kubernetes.io/projected/d45f1530-fe47-4a0e-896f-24fc8c6c0af3-kube-api-access-77bn5\") pod \"test-curl-7527-140539711889744\" (UID: \"d45f1530-fe47-4a0e-896f-24fc8c6c0af3\") " pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:42.433847 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.433820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bn5\" (UniqueName: \"kubernetes.io/projected/d45f1530-fe47-4a0e-896f-24fc8c6c0af3-kube-api-access-77bn5\") pod \"test-curl-7527-140539711889744\" (UID: \"d45f1530-fe47-4a0e-896f-24fc8c6c0af3\") " pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:42.443712 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.443682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bn5\" (UniqueName: \"kubernetes.io/projected/d45f1530-fe47-4a0e-896f-24fc8c6c0af3-kube-api-access-77bn5\") pod \"test-curl-7527-140539711889744\" (UID: \"d45f1530-fe47-4a0e-896f-24fc8c6c0af3\") " pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:42.554279 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.554208    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:42.682916 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:42.682886    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:42.684860 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:29:42.684837    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd45f1530_fe47_4a0e_896f_24fc8c6c0af3.slice/crio-8dd8fdccc433fc89312ae773e6b839466da82f0918a623a06ef4146efe154116 WatchSource:0}: Error finding container 8dd8fdccc433fc89312ae773e6b839466da82f0918a623a06ef4146efe154116: Status 404 returned error can't find the container with id 8dd8fdccc433fc89312ae773e6b839466da82f0918a623a06ef4146efe154116
Jul 31 22:29:43.002911 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:43.002887    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711889744" event={"ID":"d45f1530-fe47-4a0e-896f-24fc8c6c0af3","Type":"ContainerStarted","Data":"8dd8fdccc433fc89312ae773e6b839466da82f0918a623a06ef4146efe154116"}
Jul 31 22:29:43.755371 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:43.755328    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c" podUID="672207ef-e82c-46fd-a4ef-42c93897d3e8" containerName="main" containerID="cri-o://5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8" gracePeriod=45
Jul 31 22:29:43.996454 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:43.996431    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:29:44.008786 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.008725    2557 generic.go:356] "Generic (PLEG): container finished" podID="d45f1530-fe47-4a0e-896f-24fc8c6c0af3" containerID="423d5cca3d05132ccb5c053221c389cc94514a40f99aa1b3785e9c04db7b2f26" exitCode=0
Jul 31 22:29:44.008886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.008800    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711889744" event={"ID":"d45f1530-fe47-4a0e-896f-24fc8c6c0af3","Type":"ContainerDied","Data":"423d5cca3d05132ccb5c053221c389cc94514a40f99aa1b3785e9c04db7b2f26"}
Jul 31 22:29:44.010009 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.009989    2557 generic.go:356] "Generic (PLEG): container finished" podID="672207ef-e82c-46fd-a4ef-42c93897d3e8" containerID="5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8" exitCode=0
Jul 31 22:29:44.010095 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.010047    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c" event={"ID":"672207ef-e82c-46fd-a4ef-42c93897d3e8","Type":"ContainerDied","Data":"5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8"}
Jul 31 22:29:44.010095 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.010067    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"
Jul 31 22:29:44.010095 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.010079    2557 scope.go:117] "RemoveContainer" containerID="5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8"
Jul 31 22:29:44.010218 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.010070    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c" event={"ID":"672207ef-e82c-46fd-a4ef-42c93897d3e8","Type":"ContainerDied","Data":"fd9d481ad39a4cb70c6d370f6a76d2777adee348349d2c3f34e956b2746288c0"}
Jul 31 22:29:44.019750 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.019731    2557 scope.go:117] "RemoveContainer" containerID="5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8"
Jul 31 22:29:44.020042 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:29:44.020016    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8\": container with ID starting with 5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8 not found: ID does not exist" containerID="5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8"
Jul 31 22:29:44.020156 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.020047    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8"} err="failed to get container status \"5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8\": rpc error: code = NotFound desc = could not find container \"5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8\": container with ID starting with 5713e01828bb2b8fe6de2ae2685ca41f83710e7895023e36809b1a5bc6615af8 not found: ID does not exist"
Jul 31 22:29:44.146659 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.146629    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-model-cache\") pod \"672207ef-e82c-46fd-a4ef-42c93897d3e8\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") "
Jul 31 22:29:44.146659 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.146665    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-dshm\") pod \"672207ef-e82c-46fd-a4ef-42c93897d3e8\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") "
Jul 31 22:29:44.146921 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.146683    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kj6w\" (UniqueName: \"kubernetes.io/projected/672207ef-e82c-46fd-a4ef-42c93897d3e8-kube-api-access-6kj6w\") pod \"672207ef-e82c-46fd-a4ef-42c93897d3e8\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") "
Jul 31 22:29:44.146921 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.146718    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/672207ef-e82c-46fd-a4ef-42c93897d3e8-tls-certs\") pod \"672207ef-e82c-46fd-a4ef-42c93897d3e8\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") "
Jul 31 22:29:44.146921 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.146756    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-home\") pod \"672207ef-e82c-46fd-a4ef-42c93897d3e8\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") "
Jul 31 22:29:44.146921 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.146813    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-tmp-dir\") pod \"672207ef-e82c-46fd-a4ef-42c93897d3e8\" (UID: \"672207ef-e82c-46fd-a4ef-42c93897d3e8\") "
Jul 31 22:29:44.147274 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.147146    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "672207ef-e82c-46fd-a4ef-42c93897d3e8" (UID: "672207ef-e82c-46fd-a4ef-42c93897d3e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:44.147274 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.147184    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-home" (OuterVolumeSpecName: "home") pod "672207ef-e82c-46fd-a4ef-42c93897d3e8" (UID: "672207ef-e82c-46fd-a4ef-42c93897d3e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:44.147274 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.147251    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "672207ef-e82c-46fd-a4ef-42c93897d3e8" (UID: "672207ef-e82c-46fd-a4ef-42c93897d3e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:44.148856 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.148828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-dshm" (OuterVolumeSpecName: "dshm") pod "672207ef-e82c-46fd-a4ef-42c93897d3e8" (UID: "672207ef-e82c-46fd-a4ef-42c93897d3e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:44.148981 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.148872    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672207ef-e82c-46fd-a4ef-42c93897d3e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "672207ef-e82c-46fd-a4ef-42c93897d3e8" (UID: "672207ef-e82c-46fd-a4ef-42c93897d3e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:29:44.148981 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.148932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672207ef-e82c-46fd-a4ef-42c93897d3e8-kube-api-access-6kj6w" (OuterVolumeSpecName: "kube-api-access-6kj6w") pod "672207ef-e82c-46fd-a4ef-42c93897d3e8" (UID: "672207ef-e82c-46fd-a4ef-42c93897d3e8"). InnerVolumeSpecName "kube-api-access-6kj6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:44.247620 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.247584    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:44.247620 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.247613    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:44.247620 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.247624    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:44.247840 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.247633    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kj6w\" (UniqueName: \"kubernetes.io/projected/672207ef-e82c-46fd-a4ef-42c93897d3e8-kube-api-access-6kj6w\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:44.247840 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.247642    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/672207ef-e82c-46fd-a4ef-42c93897d3e8-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:44.247840 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.247649    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/672207ef-e82c-46fd-a4ef-42c93897d3e8-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:44.332089 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.332062    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"]
Jul 31 22:29:44.336295 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.336271    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ee9929/rate-test-model-ee9929-kserve-7d949d586c-vz49c"]
Jul 31 22:29:44.485922 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.485882    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672207ef-e82c-46fd-a4ef-42c93897d3e8" path="/var/lib/kubelet/pods/672207ef-e82c-46fd-a4ef-42c93897d3e8/volumes"
Jul 31 22:29:44.757339 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:44.757307    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx" podUID="d42e4d13-6bdd-48e7-8be4-43e861237ce7" containerName="main" containerID="cri-o://7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110" gracePeriod=45
Jul 31 22:29:45.003895 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.003868    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:29:45.016572 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.016510    2557 generic.go:356] "Generic (PLEG): container finished" podID="d42e4d13-6bdd-48e7-8be4-43e861237ce7" containerID="7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110" exitCode=0
Jul 31 22:29:45.016572 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.016551    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"
Jul 31 22:29:45.016708 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.016548    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx" event={"ID":"d42e4d13-6bdd-48e7-8be4-43e861237ce7","Type":"ContainerDied","Data":"7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110"}
Jul 31 22:29:45.016708 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.016675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx" event={"ID":"d42e4d13-6bdd-48e7-8be4-43e861237ce7","Type":"ContainerDied","Data":"bd58dd958819298023aff53bf1c65398e0eb754100e54dfe4936f434abc0127b"}
Jul 31 22:29:45.016708 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.016700    2557 scope.go:117] "RemoveContainer" containerID="7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110"
Jul 31 22:29:45.025856 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.025766    2557 scope.go:117] "RemoveContainer" containerID="7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110"
Jul 31 22:29:45.026299 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:29:45.026185    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110\": container with ID starting with 7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110 not found: ID does not exist" containerID="7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110"
Jul 31 22:29:45.026299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.026222    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110"} err="failed to get container status \"7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110\": rpc error: code = NotFound desc = could not find container \"7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110\": container with ID starting with 7c8eb044a623840e46f883d233059b1cbce976242aee0f10c6026d6e39cee110 not found: ID does not exist"
Jul 31 22:29:45.149222 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.149198    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:45.154099 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154083    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lx85\" (UniqueName: \"kubernetes.io/projected/d42e4d13-6bdd-48e7-8be4-43e861237ce7-kube-api-access-9lx85\") pod \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") "
Jul 31 22:29:45.154150 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154126    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tmp-dir\") pod \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") "
Jul 31 22:29:45.154182 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154155    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-home\") pod \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") "
Jul 31 22:29:45.154225 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154198    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-model-cache\") pod \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") "
Jul 31 22:29:45.154225 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154218    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-dshm\") pod \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") "
Jul 31 22:29:45.154298 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154249    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tls-certs\") pod \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\" (UID: \"d42e4d13-6bdd-48e7-8be4-43e861237ce7\") "
Jul 31 22:29:45.154388 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154363    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d42e4d13-6bdd-48e7-8be4-43e861237ce7" (UID: "d42e4d13-6bdd-48e7-8be4-43e861237ce7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:45.154480 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154460    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-model-cache" (OuterVolumeSpecName: "model-cache") pod "d42e4d13-6bdd-48e7-8be4-43e861237ce7" (UID: "d42e4d13-6bdd-48e7-8be4-43e861237ce7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:45.154530 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154476    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-home" (OuterVolumeSpecName: "home") pod "d42e4d13-6bdd-48e7-8be4-43e861237ce7" (UID: "d42e4d13-6bdd-48e7-8be4-43e861237ce7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:45.154593 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154570    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.154642 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154589    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.154642 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.154603    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.156262 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.156235    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-dshm" (OuterVolumeSpecName: "dshm") pod "d42e4d13-6bdd-48e7-8be4-43e861237ce7" (UID: "d42e4d13-6bdd-48e7-8be4-43e861237ce7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:29:45.156357 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.156267    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d42e4d13-6bdd-48e7-8be4-43e861237ce7" (UID: "d42e4d13-6bdd-48e7-8be4-43e861237ce7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:29:45.156357 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.156300    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42e4d13-6bdd-48e7-8be4-43e861237ce7-kube-api-access-9lx85" (OuterVolumeSpecName: "kube-api-access-9lx85") pod "d42e4d13-6bdd-48e7-8be4-43e861237ce7" (UID: "d42e4d13-6bdd-48e7-8be4-43e861237ce7"). InnerVolumeSpecName "kube-api-access-9lx85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:45.170232 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.170205    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7527-140539711889744_d45f1530-fe47-4a0e-896f-24fc8c6c0af3/test-curl-7527-140539711889744/0.log"
Jul 31 22:29:45.194696 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.194669    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:45.199175 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.199157    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:45.254998 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.254974    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77bn5\" (UniqueName: \"kubernetes.io/projected/d45f1530-fe47-4a0e-896f-24fc8c6c0af3-kube-api-access-77bn5\") pod \"d45f1530-fe47-4a0e-896f-24fc8c6c0af3\" (UID: \"d45f1530-fe47-4a0e-896f-24fc8c6c0af3\") "
Jul 31 22:29:45.255179 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.255163    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d42e4d13-6bdd-48e7-8be4-43e861237ce7-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.255233 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.255184    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42e4d13-6bdd-48e7-8be4-43e861237ce7-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.255233 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.255198    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lx85\" (UniqueName: \"kubernetes.io/projected/d42e4d13-6bdd-48e7-8be4-43e861237ce7-kube-api-access-9lx85\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.256853 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.256831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45f1530-fe47-4a0e-896f-24fc8c6c0af3-kube-api-access-77bn5" (OuterVolumeSpecName: "kube-api-access-77bn5") pod "d45f1530-fe47-4a0e-896f-24fc8c6c0af3" (UID: "d45f1530-fe47-4a0e-896f-24fc8c6c0af3"). InnerVolumeSpecName "kube-api-access-77bn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:45.324257 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324195    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:45.324517 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324502    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45f1530-fe47-4a0e-896f-24fc8c6c0af3" containerName="test-curl-7527-140539711889744"
Jul 31 22:29:45.324573 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324521    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45f1530-fe47-4a0e-896f-24fc8c6c0af3" containerName="test-curl-7527-140539711889744"
Jul 31 22:29:45.324573 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324535    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42e4d13-6bdd-48e7-8be4-43e861237ce7" containerName="main"
Jul 31 22:29:45.324573 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324541    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42e4d13-6bdd-48e7-8be4-43e861237ce7" containerName="main"
Jul 31 22:29:45.324573 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324549    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672207ef-e82c-46fd-a4ef-42c93897d3e8" containerName="main"
Jul 31 22:29:45.324573 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324554    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="672207ef-e82c-46fd-a4ef-42c93897d3e8" containerName="main"
Jul 31 22:29:45.324917 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324622    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42e4d13-6bdd-48e7-8be4-43e861237ce7" containerName="main"
Jul 31 22:29:45.324917 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324634    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45f1530-fe47-4a0e-896f-24fc8c6c0af3" containerName="test-curl-7527-140539711889744"
Jul 31 22:29:45.324917 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.324643    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="672207ef-e82c-46fd-a4ef-42c93897d3e8" containerName="main"
Jul 31 22:29:45.327681 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.327666    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:45.339698 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.339677    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:45.348814 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.348791    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"]
Jul 31 22:29:45.352477 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.352459    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-21e950/rate-test-model-21e950-kserve-7dcdcfbf6c-pppcx"]
Jul 31 22:29:45.355723 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.355707    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77bn5\" (UniqueName: \"kubernetes.io/projected/d45f1530-fe47-4a0e-896f-24fc8c6c0af3-kube-api-access-77bn5\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:45.456676 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.456655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb6gj\" (UniqueName: \"kubernetes.io/projected/5b2e244b-01cf-46a4-a0d9-296829b0c44e-kube-api-access-bb6gj\") pod \"test-curl-7527-140539711889744\" (UID: \"5b2e244b-01cf-46a4-a0d9-296829b0c44e\") " pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:45.557670 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.557648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb6gj\" (UniqueName: \"kubernetes.io/projected/5b2e244b-01cf-46a4-a0d9-296829b0c44e-kube-api-access-bb6gj\") pod \"test-curl-7527-140539711889744\" (UID: \"5b2e244b-01cf-46a4-a0d9-296829b0c44e\") " pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:45.566867 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.566840    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb6gj\" (UniqueName: \"kubernetes.io/projected/5b2e244b-01cf-46a4-a0d9-296829b0c44e-kube-api-access-bb6gj\") pod \"test-curl-7527-140539711889744\" (UID: \"5b2e244b-01cf-46a4-a0d9-296829b0c44e\") " pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:45.635877 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.635825    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:45.759347 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:45.759324    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:45.761240 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:29:45.761215    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b2e244b_01cf_46a4_a0d9_296829b0c44e.slice/crio-580b47bc2e6a2c14d4e412128521c6c2d41fe907d783af64b4623acd3ac02fd8 WatchSource:0}: Error finding container 580b47bc2e6a2c14d4e412128521c6c2d41fe907d783af64b4623acd3ac02fd8: Status 404 returned error can't find the container with id 580b47bc2e6a2c14d4e412128521c6c2d41fe907d783af64b4623acd3ac02fd8
Jul 31 22:29:46.022724 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:46.022700    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:46.022724 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:46.022726    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dd8fdccc433fc89312ae773e6b839466da82f0918a623a06ef4146efe154116"
Jul 31 22:29:46.023835 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:46.023802    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711889744" event={"ID":"5b2e244b-01cf-46a4-a0d9-296829b0c44e","Type":"ContainerStarted","Data":"580b47bc2e6a2c14d4e412128521c6c2d41fe907d783af64b4623acd3ac02fd8"}
Jul 31 22:29:46.034978 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:46.034936    2557 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7527-140539711889744" oldPodUID="d45f1530-fe47-4a0e-896f-24fc8c6c0af3" podUID="5b2e244b-01cf-46a4-a0d9-296829b0c44e"
Jul 31 22:29:46.486481 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:46.486453    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42e4d13-6bdd-48e7-8be4-43e861237ce7" path="/var/lib/kubelet/pods/d42e4d13-6bdd-48e7-8be4-43e861237ce7/volumes"
Jul 31 22:29:46.486819 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:46.486803    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45f1530-fe47-4a0e-896f-24fc8c6c0af3" path="/var/lib/kubelet/pods/d45f1530-fe47-4a0e-896f-24fc8c6c0af3/volumes"
Jul 31 22:29:47.030235 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:47.030206    2557 generic.go:356] "Generic (PLEG): container finished" podID="5b2e244b-01cf-46a4-a0d9-296829b0c44e" containerID="4bfec8cbb34f372310f93523979e5d2c7700a4e030ef3f5e64ff98cac8dd2ba4" exitCode=0
Jul 31 22:29:47.030604 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:47.030251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-140539711889744" event={"ID":"5b2e244b-01cf-46a4-a0d9-296829b0c44e","Type":"ContainerDied","Data":"4bfec8cbb34f372310f93523979e5d2c7700a4e030ef3f5e64ff98cac8dd2ba4"}
Jul 31 22:29:48.169092 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.169067    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:48.191284 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.191261    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7527-140539711889744_5b2e244b-01cf-46a4-a0d9-296829b0c44e/test-curl-7527-140539711889744/0.log"
Jul 31 22:29:48.214400 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.214372    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:48.220287 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.220268    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7527-140539711889744"]
Jul 31 22:29:48.281458 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.281434    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb6gj\" (UniqueName: \"kubernetes.io/projected/5b2e244b-01cf-46a4-a0d9-296829b0c44e-kube-api-access-bb6gj\") pod \"5b2e244b-01cf-46a4-a0d9-296829b0c44e\" (UID: \"5b2e244b-01cf-46a4-a0d9-296829b0c44e\") "
Jul 31 22:29:48.283427 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.283399    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b2e244b-01cf-46a4-a0d9-296829b0c44e-kube-api-access-bb6gj" (OuterVolumeSpecName: "kube-api-access-bb6gj") pod "5b2e244b-01cf-46a4-a0d9-296829b0c44e" (UID: "5b2e244b-01cf-46a4-a0d9-296829b0c44e"). InnerVolumeSpecName "kube-api-access-bb6gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:48.382496 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.382467    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb6gj\" (UniqueName: \"kubernetes.io/projected/5b2e244b-01cf-46a4-a0d9-296829b0c44e-kube-api-access-bb6gj\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:29:48.488507 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:48.488477    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b2e244b-01cf-46a4-a0d9-296829b0c44e" path="/var/lib/kubelet/pods/5b2e244b-01cf-46a4-a0d9-296829b0c44e/volumes"
Jul 31 22:29:49.041361 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:49.041329    2557 scope.go:117] "RemoveContainer" containerID="4bfec8cbb34f372310f93523979e5d2c7700a4e030ef3f5e64ff98cac8dd2ba4"
Jul 31 22:29:49.041526 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:49.041342    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-140539711889744"
Jul 31 22:29:53.731729 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.731696    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"]
Jul 31 22:29:53.732211 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.732005    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b2e244b-01cf-46a4-a0d9-296829b0c44e" containerName="test-curl-7527-140539711889744"
Jul 31 22:29:53.732211 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.732018    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b2e244b-01cf-46a4-a0d9-296829b0c44e" containerName="test-curl-7527-140539711889744"
Jul 31 22:29:53.732211 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.732083    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b2e244b-01cf-46a4-a0d9-296829b0c44e" containerName="test-curl-7527-140539711889744"
Jul 31 22:29:53.736262 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.736241    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:53.740106 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.740087    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-068335\""
Jul 31 22:29:53.740357 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.740336    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-068335-dockercfg-qptk2\""
Jul 31 22:29:53.741426 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.741408    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 22:29:53.741527 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.741501    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 22:29:53.756068 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.756044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"]
Jul 31 22:29:53.923197 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.923167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ffc74e-3d5b-41fa-855a-0f09783392cc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:53.923329 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:53.923214    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5mh\" (UniqueName: \"kubernetes.io/projected/45ffc74e-3d5b-41fa-855a-0f09783392cc-kube-api-access-gs5mh\") pod \"payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:54.024082 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:54.024024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ffc74e-3d5b-41fa-855a-0f09783392cc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:54.024082 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:54.024060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5mh\" (UniqueName: \"kubernetes.io/projected/45ffc74e-3d5b-41fa-855a-0f09783392cc-kube-api-access-gs5mh\") pod \"payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:54.024684 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:54.024664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ffc74e-3d5b-41fa-855a-0f09783392cc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:54.032727 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:54.032698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5mh\" (UniqueName: \"kubernetes.io/projected/45ffc74e-3d5b-41fa-855a-0f09783392cc-kube-api-access-gs5mh\") pod \"payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:54.045669 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:54.045651    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:54.382127 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:54.382101    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"]
Jul 31 22:29:54.384153 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:29:54.384118    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ffc74e_3d5b_41fa_855a_0f09783392cc.slice/crio-15a2688414c5ca0e548d8f6a041b131c1ad64ac35fbf91430386c3b26903f7ce WatchSource:0}: Error finding container 15a2688414c5ca0e548d8f6a041b131c1ad64ac35fbf91430386c3b26903f7ce: Status 404 returned error can't find the container with id 15a2688414c5ca0e548d8f6a041b131c1ad64ac35fbf91430386c3b26903f7ce
Jul 31 22:29:55.071553 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:55.071478    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8" event={"ID":"45ffc74e-3d5b-41fa-855a-0f09783392cc","Type":"ContainerStarted","Data":"15a2688414c5ca0e548d8f6a041b131c1ad64ac35fbf91430386c3b26903f7ce"}
Jul 31 22:29:56.078311 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:56.078278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8" event={"ID":"45ffc74e-3d5b-41fa-855a-0f09783392cc","Type":"ContainerStarted","Data":"88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d"}
Jul 31 22:29:56.078712 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:56.078365    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:29:56.096363 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:56.096318    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8" podStartSLOduration=1.531064092 podStartE2EDuration="3.096304916s" totalImagesPullingTime="1.565240824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:29:56.095549642 +0000 UTC m=+3222.178558448" watchObservedRunningTime="2026-07-31 22:29:56.096304916 +0000 UTC m=+3222.179313698"
Jul 31 22:29:56.229721 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:29:56.229693    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:30:00.150644 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:00.150610    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"]
Jul 31 22:30:00.154161 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:00.154127    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"
Jul 31 22:30:00.157167 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:00.157141    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:30:00.164210 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:00.164179    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"]
Jul 31 22:30:00.166380 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:00.166350    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"
Jul 31 22:30:00.298667 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:00.298641    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"]
Jul 31 22:30:00.300125 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:30:00.300097    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72694462_e741_436e_9e87_d7fa28cd4e08.slice/crio-4bb517cfb7c59e84f68c74ea8a34a8c360c1ac4a4d275f9fc28baa9f63fa0f9e WatchSource:0}: Error finding container 4bb517cfb7c59e84f68c74ea8a34a8c360c1ac4a4d275f9fc28baa9f63fa0f9e: Status 404 returned error can't find the container with id 4bb517cfb7c59e84f68c74ea8a34a8c360c1ac4a4d275f9fc28baa9f63fa0f9e
Jul 31 22:30:01.106060 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:01.106017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm" event={"ID":"72694462-e741-436e-9e87-d7fa28cd4e08","Type":"ContainerStarted","Data":"4bb517cfb7c59e84f68c74ea8a34a8c360c1ac4a4d275f9fc28baa9f63fa0f9e"}
Jul 31 22:30:03.116029 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:03.115953    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm" event={"ID":"72694462-e741-436e-9e87-d7fa28cd4e08","Type":"ContainerStarted","Data":"7b13b295a2645941966d5a7afe6f426c14356d2c47388ebf2df8f1e4188dbaae"}
Jul 31 22:30:03.130370 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:03.130321    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm" podStartSLOduration=0.615789437 podStartE2EDuration="3.130306624s" totalImagesPullingTime="2.514517187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:03.129645777 +0000 UTC m=+3229.212654582" watchObservedRunningTime="2026-07-31 22:30:03.130306624 +0000 UTC m=+3229.213315476"
Jul 31 22:30:04.123418 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:04.123367    2557 generic.go:356] "Generic (PLEG): container finished" podID="72694462-e741-436e-9e87-d7fa28cd4e08" containerID="7b13b295a2645941966d5a7afe6f426c14356d2c47388ebf2df8f1e4188dbaae" exitCode=0
Jul 31 22:30:04.123813 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:04.123458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm" event={"ID":"72694462-e741-436e-9e87-d7fa28cd4e08","Type":"ContainerDied","Data":"7b13b295a2645941966d5a7afe6f426c14356d2c47388ebf2df8f1e4188dbaae"}
Jul 31 22:30:05.257376 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:05.257353    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"
Jul 31 22:30:06.134515 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:06.134481    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"
Jul 31 22:30:06.134515 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:06.134498    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm" event={"ID":"72694462-e741-436e-9e87-d7fa28cd4e08","Type":"ContainerDied","Data":"4bb517cfb7c59e84f68c74ea8a34a8c360c1ac4a4d275f9fc28baa9f63fa0f9e"}
Jul 31 22:30:06.134811 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:06.134547    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bb517cfb7c59e84f68c74ea8a34a8c360c1ac4a4d275f9fc28baa9f63fa0f9e"
Jul 31 22:30:07.086040 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:07.085969    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:30:21.598019 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.597951    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"]
Jul 31 22:30:21.598472 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.598335    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72694462-e741-436e-9e87-d7fa28cd4e08" containerName="cleanup"
Jul 31 22:30:21.598472 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.598347    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="72694462-e741-436e-9e87-d7fa28cd4e08" containerName="cleanup"
Jul 31 22:30:21.598472 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.598405    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="72694462-e741-436e-9e87-d7fa28cd4e08" containerName="cleanup"
Jul 31 22:30:21.603117 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.603091    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.606163 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.606141    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g8mcz\""
Jul 31 22:30:21.606402 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.606175    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:30:21.607141 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.607121    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-a88a46-serving-cert\""
Jul 31 22:30:21.607292 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.607275    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 22:30:21.617343 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.617322    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"]
Jul 31 22:30:21.623938 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.623915    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjrj\" (UniqueName: \"kubernetes.io/projected/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-kube-api-access-cmjrj\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.624046 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.623984    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.624097 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.624081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.725079 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.725043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.725270 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.725133    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.725270 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.725183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjrj\" (UniqueName: \"kubernetes.io/projected/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-kube-api-access-cmjrj\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.725778 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.725757    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.727666 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.727644    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-maas-api-tls\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.738059 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.738039    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjrj\" (UniqueName: \"kubernetes.io/projected/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-kube-api-access-cmjrj\") pod \"maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:21.913368 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:21.913298    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:22.043994 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.043940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"]
Jul 31 22:30:22.046667 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:30:22.046643    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cef7a1a_9694_460f_85ae_5dbae2d45c8b.slice/crio-26b807a47133eb08254b4bd9401b507c6fffda537682abab1f7589eb5d025f1d WatchSource:0}: Error finding container 26b807a47133eb08254b4bd9401b507c6fffda537682abab1f7589eb5d025f1d: Status 404 returned error can't find the container with id 26b807a47133eb08254b4bd9401b507c6fffda537682abab1f7589eb5d025f1d
Jul 31 22:30:22.215202 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.215108    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h" event={"ID":"2cef7a1a-9694-460f-85ae-5dbae2d45c8b","Type":"ContainerStarted","Data":"26b807a47133eb08254b4bd9401b507c6fffda537682abab1f7589eb5d025f1d"}
Jul 31 22:30:22.323163 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.323133    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"]
Jul 31 22:30:22.327808 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.327785    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.330656 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.330635    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-a88a46-dockercfg-xg49c\""
Jul 31 22:30:22.330821 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.330804    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a88a46\""
Jul 31 22:30:22.338364 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.338342    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"]
Jul 31 22:30:22.368534 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.368513    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"]
Jul 31 22:30:22.371654 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.371639    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.393838 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.393817    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"]
Jul 31 22:30:22.431074 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.431045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtzzx\" (UniqueName: \"kubernetes.io/projected/6b739a58-d798-49a2-a790-5bfcff62dcc8-kube-api-access-jtzzx\") pod \"payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.431198 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.431085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbks8\" (UniqueName: \"kubernetes.io/projected/d91b710c-1924-4912-8d6a-00b2809d1c9b-kube-api-access-lbks8\") pod \"payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.431198 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.431111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d91b710c-1924-4912-8d6a-00b2809d1c9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.431198 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.431185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b739a58-d798-49a2-a790-5bfcff62dcc8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.532077 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.532043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbks8\" (UniqueName: \"kubernetes.io/projected/d91b710c-1924-4912-8d6a-00b2809d1c9b-kube-api-access-lbks8\") pod \"payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.532077 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.532079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d91b710c-1924-4912-8d6a-00b2809d1c9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.532313 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.532157    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b739a58-d798-49a2-a790-5bfcff62dcc8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.532313 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.532257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtzzx\" (UniqueName: \"kubernetes.io/projected/6b739a58-d798-49a2-a790-5bfcff62dcc8-kube-api-access-jtzzx\") pod \"payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.532985 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.532925    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d91b710c-1924-4912-8d6a-00b2809d1c9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.533129 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.533106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b739a58-d798-49a2-a790-5bfcff62dcc8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.541450 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.541427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbks8\" (UniqueName: \"kubernetes.io/projected/d91b710c-1924-4912-8d6a-00b2809d1c9b-kube-api-access-lbks8\") pod \"payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.541450 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.541438    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtzzx\" (UniqueName: \"kubernetes.io/projected/6b739a58-d798-49a2-a790-5bfcff62dcc8-kube-api-access-jtzzx\") pod \"payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.638215 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.638156    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:22.680066 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.680037    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:22.800639 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.800570    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"]
Jul 31 22:30:22.803851 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:30:22.803815    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b739a58_d798_49a2_a790_5bfcff62dcc8.slice/crio-7401e95093eb0b35a8976dd3725e12bf2672ae538bb1afef4a473fdf0757e4d3 WatchSource:0}: Error finding container 7401e95093eb0b35a8976dd3725e12bf2672ae538bb1afef4a473fdf0757e4d3: Status 404 returned error can't find the container with id 7401e95093eb0b35a8976dd3725e12bf2672ae538bb1afef4a473fdf0757e4d3
Jul 31 22:30:22.838093 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:22.838068    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"]
Jul 31 22:30:22.842447 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:30:22.842412    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91b710c_1924_4912_8d6a_00b2809d1c9b.slice/crio-6f1ad3b327bd2af7f5e57216df22321264ff4aafbe9f58c4895867e72f50e692 WatchSource:0}: Error finding container 6f1ad3b327bd2af7f5e57216df22321264ff4aafbe9f58c4895867e72f50e692: Status 404 returned error can't find the container with id 6f1ad3b327bd2af7f5e57216df22321264ff4aafbe9f58c4895867e72f50e692
Jul 31 22:30:23.222340 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.222302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf" event={"ID":"6b739a58-d798-49a2-a790-5bfcff62dcc8","Type":"ContainerStarted","Data":"2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba"}
Jul 31 22:30:23.222531 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.222377    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:23.222531 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.222402    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf" event={"ID":"6b739a58-d798-49a2-a790-5bfcff62dcc8","Type":"ContainerStarted","Data":"7401e95093eb0b35a8976dd3725e12bf2672ae538bb1afef4a473fdf0757e4d3"}
Jul 31 22:30:23.224014 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.223986    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj" event={"ID":"d91b710c-1924-4912-8d6a-00b2809d1c9b","Type":"ContainerStarted","Data":"cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c"}
Jul 31 22:30:23.224165 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.224043    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj" event={"ID":"d91b710c-1924-4912-8d6a-00b2809d1c9b","Type":"ContainerStarted","Data":"6f1ad3b327bd2af7f5e57216df22321264ff4aafbe9f58c4895867e72f50e692"}
Jul 31 22:30:23.224165 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.224085    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:23.241250 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.241199    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf" podStartSLOduration=1.241180814 podStartE2EDuration="1.241180814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:23.239836935 +0000 UTC m=+3249.322845739" watchObservedRunningTime="2026-07-31 22:30:23.241180814 +0000 UTC m=+3249.324189620"
Jul 31 22:30:23.263189 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:23.263138    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj" podStartSLOduration=1.263118583 podStartE2EDuration="1.263118583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:23.262937096 +0000 UTC m=+3249.345945902" watchObservedRunningTime="2026-07-31 22:30:23.263118583 +0000 UTC m=+3249.346127389"
Jul 31 22:30:24.229576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:24.229534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h" event={"ID":"2cef7a1a-9694-460f-85ae-5dbae2d45c8b","Type":"ContainerStarted","Data":"d6ff60ee7c200f52a6d48a701260c0c54facf9d3a56b5b4a2387a555f42a7dc6"}
Jul 31 22:30:24.258101 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:24.258053    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h" podStartSLOduration=1.9609622359999999 podStartE2EDuration="3.258038574s" totalImagesPullingTime="1.297076338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:24.256318615 +0000 UTC m=+3250.339327419" watchObservedRunningTime="2026-07-31 22:30:24.258038574 +0000 UTC m=+3250.341047379"
Jul 31 22:30:24.935674 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:24.935638    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:30:25.233459 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:25.233433    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:31.242555 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:31.242523    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:30:34.232148 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:34.232115    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:30:34.232598 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:34.232282    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:30:52.536241 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:52.536210    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf_6b739a58-d798-49a2-a790-5bfcff62dcc8/payload-processing/0.log"
Jul 31 22:30:54.975637 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:54.975600    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"]
Jul 31 22:30:54.979861 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:54.979842    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:54.983308 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:54.983285    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-068335\"/\"default-dockercfg-m265s\""
Jul 31 22:30:54.983437 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:54.983388    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-068335\"/\"openshift-service-ca.crt\""
Jul 31 22:30:54.984339 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:54.984320    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-068335\"/\"kube-root-ca.crt\""
Jul 31 22:30:54.984643 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:54.984629    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-068335\"/\"ipp-route-068335-kserve-self-signed-certs\""
Jul 31 22:30:55.007223 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.007202    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"]
Jul 31 22:30:55.057575 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.057551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-tmp-dir\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.057676 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.057584    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92745\" (UniqueName: \"kubernetes.io/projected/d28a1369-a5cf-417f-9373-44f7b14c8a80-kube-api-access-92745\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.057676 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.057618    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-model-cache\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.057765 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.057711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-home\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.057765 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.057743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28a1369-a5cf-417f-9373-44f7b14c8a80-tls-certs\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.057840 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.057772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-dshm\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.158859 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.158836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92745\" (UniqueName: \"kubernetes.io/projected/d28a1369-a5cf-417f-9373-44f7b14c8a80-kube-api-access-92745\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.158983 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.158874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-model-cache\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.158983 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.158893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-home\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.158983 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.158908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28a1369-a5cf-417f-9373-44f7b14c8a80-tls-certs\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.158983 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.158932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-dshm\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.159197 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.159011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-tmp-dir\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.159384 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.159324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-model-cache\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.159384 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.159358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-home\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.159497 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.159413    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-tmp-dir\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.161409 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.161389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28a1369-a5cf-417f-9373-44f7b14c8a80-tls-certs\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.161510 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.161496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-dshm\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.166601 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.166577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92745\" (UniqueName: \"kubernetes.io/projected/d28a1369-a5cf-417f-9373-44f7b14c8a80-kube-api-access-92745\") pod \"ipp-route-068335-kserve-578cd4fbcf-qlrjq\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") " pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.288947 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.288879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:30:55.426020 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:55.425995    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"]
Jul 31 22:30:55.427522 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:30:55.427495    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd28a1369_a5cf_417f_9373_44f7b14c8a80.slice/crio-24045657196f3fc5df5d46401f831c45a60544e68cb3154095915db4f3ef6cab WatchSource:0}: Error finding container 24045657196f3fc5df5d46401f831c45a60544e68cb3154095915db4f3ef6cab: Status 404 returned error can't find the container with id 24045657196f3fc5df5d46401f831c45a60544e68cb3154095915db4f3ef6cab
Jul 31 22:30:56.374687 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:56.374655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq" event={"ID":"d28a1369-a5cf-417f-9373-44f7b14c8a80","Type":"ContainerStarted","Data":"fa2c40c887994d6d2e1d94b6955689f76b03c6785ff7d802fdbe071bbc70c42c"}
Jul 31 22:30:56.375047 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:56.374695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq" event={"ID":"d28a1369-a5cf-417f-9373-44f7b14c8a80","Type":"ContainerStarted","Data":"24045657196f3fc5df5d46401f831c45a60544e68cb3154095915db4f3ef6cab"}
Jul 31 22:30:56.395321 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:56.395273    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq" podStartSLOduration=2.395258997 podStartE2EDuration="2.395258997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:56.394060838 +0000 UTC m=+3282.477069644" watchObservedRunningTime="2026-07-31 22:30:56.395258997 +0000 UTC m=+3282.478268076"
Jul 31 22:30:57.548783 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:30:57.548751    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:31:05.289972 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:05.289922    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:31:05.290485 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:05.289993    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:31:05.302472 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:05.302449    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:31:05.425122 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:05.425094    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:31:14.580733 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:14.580702    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:31:14.585759 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:14.585740    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgcgb_24b19b15-9bf1-4c15-9b56-8253ab9ecc5d/ovn-acl-logging/0.log"
Jul 31 22:31:26.137155 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:26.137116    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:31:37.263715 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:37.263631    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8_45ffc74e-3d5b-41fa-855a-0f09783392cc/payload-processing/0.log"
Jul 31 22:31:37.503208 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:37.503179    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf_6b739a58-d798-49a2-a790-5bfcff62dcc8/payload-processing/0.log"
Jul 31 22:31:42.552235 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.552199    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"]
Jul 31 22:31:42.554463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.554442    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.557244 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.557228    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-184ad7-serving-cert\""
Jul 31 22:31:42.566885 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.566861    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"]
Jul 31 22:31:42.624841 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.624809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.625003 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.624859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c0f21c-a246-4120-85d4-5b4a46a03efe-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.625003 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.624893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkhvm\" (UniqueName: \"kubernetes.io/projected/57c0f21c-a246-4120-85d4-5b4a46a03efe-kube-api-access-wkhvm\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.725481 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.725449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c0f21c-a246-4120-85d4-5b4a46a03efe-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.725481 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.725484    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkhvm\" (UniqueName: \"kubernetes.io/projected/57c0f21c-a246-4120-85d4-5b4a46a03efe-kube-api-access-wkhvm\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.725744 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.725539    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.725744 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:31:42.725622    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-serving-cert: secret "maas-api-e2e-ipp-cleanup-184ad7-serving-cert" not found
Jul 31 22:31:42.725744 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:31:42.725673    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls podName:57c0f21c-a246-4120-85d4-5b4a46a03efe nodeName:}" failed. No retries permitted until 2026-07-31 22:31:43.225658335 +0000 UTC m=+3329.308667122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" (UID: "57c0f21c-a246-4120-85d4-5b4a46a03efe") : secret "maas-api-e2e-ipp-cleanup-184ad7-serving-cert" not found
Jul 31 22:31:42.726111 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.726093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c0f21c-a246-4120-85d4-5b4a46a03efe-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:42.740744 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:42.740713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkhvm\" (UniqueName: \"kubernetes.io/projected/57c0f21c-a246-4120-85d4-5b4a46a03efe-kube-api-access-wkhvm\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:43.230325 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.230291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:43.232531 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.232502    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:43.350271 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.350238    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"]
Jul 31 22:31:43.352646 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.352623    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.355453 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.355432    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-184ad7\""
Jul 31 22:31:43.355690 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.355671    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-184ad7-dockercfg-gktb5\""
Jul 31 22:31:43.370899 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.370874    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"]
Jul 31 22:31:43.381881 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.381860    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"]
Jul 31 22:31:43.383876 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.383861    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.398835 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.398811    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"]
Jul 31 22:31:43.432114 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.432091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a9d305b-3b74-485f-8adb-401936e95cd9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.432208 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.432131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57cv\" (UniqueName: \"kubernetes.io/projected/41dad2ec-ef39-4151-ae6e-6e0f13dac581-kube-api-access-z57cv\") pod \"payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.432208 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.432152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41dad2ec-ef39-4151-ae6e-6e0f13dac581-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.432299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.432228    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4v7b\" (UniqueName: \"kubernetes.io/projected/9a9d305b-3b74-485f-8adb-401936e95cd9-kube-api-access-v4v7b\") pod \"payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.464093 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.464072    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:43.532736 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.532706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a9d305b-3b74-485f-8adb-401936e95cd9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.532866 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.532753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57cv\" (UniqueName: \"kubernetes.io/projected/41dad2ec-ef39-4151-ae6e-6e0f13dac581-kube-api-access-z57cv\") pod \"payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.533019 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.532995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41dad2ec-ef39-4151-ae6e-6e0f13dac581-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.533279 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.533065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4v7b\" (UniqueName: \"kubernetes.io/projected/9a9d305b-3b74-485f-8adb-401936e95cd9-kube-api-access-v4v7b\") pod \"payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.533632 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.533615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41dad2ec-ef39-4151-ae6e-6e0f13dac581-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.533738 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.533718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a9d305b-3b74-485f-8adb-401936e95cd9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.541287 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.541253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57cv\" (UniqueName: \"kubernetes.io/projected/41dad2ec-ef39-4151-ae6e-6e0f13dac581-kube-api-access-z57cv\") pod \"payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.542894 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.542871    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4v7b\" (UniqueName: \"kubernetes.io/projected/9a9d305b-3b74-485f-8adb-401936e95cd9-kube-api-access-v4v7b\") pod \"payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.597943 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.597916    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"]
Jul 31 22:31:43.599455 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:31:43.599425    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c0f21c_a246_4120_85d4_5b4a46a03efe.slice/crio-8c2e0e532eba0adf17e7fbb3ce11b07c9f0f9ded587f3c9658fe1886af0e432d WatchSource:0}: Error finding container 8c2e0e532eba0adf17e7fbb3ce11b07c9f0f9ded587f3c9658fe1886af0e432d: Status 404 returned error can't find the container with id 8c2e0e532eba0adf17e7fbb3ce11b07c9f0f9ded587f3c9658fe1886af0e432d
Jul 31 22:31:43.663093 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.663067    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:43.694487 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.694452    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:43.807160 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.806312    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"]
Jul 31 22:31:43.839811 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:43.839789    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"]
Jul 31 22:31:43.846095 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:31:43.846066    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9d305b_3b74_485f_8adb_401936e95cd9.slice/crio-5de5a2171f87c6ac204f0384f6a6ff78ed3513aff9a7846c728ae7ec7d46f2a3 WatchSource:0}: Error finding container 5de5a2171f87c6ac204f0384f6a6ff78ed3513aff9a7846c728ae7ec7d46f2a3: Status 404 returned error can't find the container with id 5de5a2171f87c6ac204f0384f6a6ff78ed3513aff9a7846c728ae7ec7d46f2a3
Jul 31 22:31:44.588236 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.588201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" event={"ID":"57c0f21c-a246-4120-85d4-5b4a46a03efe","Type":"ContainerStarted","Data":"6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d"}
Jul 31 22:31:44.588411 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.588246    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" event={"ID":"57c0f21c-a246-4120-85d4-5b4a46a03efe","Type":"ContainerStarted","Data":"8c2e0e532eba0adf17e7fbb3ce11b07c9f0f9ded587f3c9658fe1886af0e432d"}
Jul 31 22:31:44.588411 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.588313    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:44.589746 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.589721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z" event={"ID":"41dad2ec-ef39-4151-ae6e-6e0f13dac581","Type":"ContainerStarted","Data":"bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2"}
Jul 31 22:31:44.589884 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.589769    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:44.589884 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.589791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z" event={"ID":"41dad2ec-ef39-4151-ae6e-6e0f13dac581","Type":"ContainerStarted","Data":"e5ed8d25195c599b9980b002a4c19ede7907af36cd6737e81c51620c8fa1bc04"}
Jul 31 22:31:44.591106 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.591084    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc" event={"ID":"9a9d305b-3b74-485f-8adb-401936e95cd9","Type":"ContainerStarted","Data":"99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e"}
Jul 31 22:31:44.591239 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.591122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc" event={"ID":"9a9d305b-3b74-485f-8adb-401936e95cd9","Type":"ContainerStarted","Data":"5de5a2171f87c6ac204f0384f6a6ff78ed3513aff9a7846c728ae7ec7d46f2a3"}
Jul 31 22:31:44.591239 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.591167    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:31:44.603988 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.603915    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" podStartSLOduration=2.2593183 podStartE2EDuration="2.603899507s" totalImagesPullingTime="344.581207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:31:44.603096169 +0000 UTC m=+3330.686104971" watchObservedRunningTime="2026-07-31 22:31:44.603899507 +0000 UTC m=+3330.686908313"
Jul 31 22:31:44.618204 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.618166    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc" podStartSLOduration=1.6181541240000001 podStartE2EDuration="1.618154124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:31:44.617802147 +0000 UTC m=+3330.700810951" watchObservedRunningTime="2026-07-31 22:31:44.618154124 +0000 UTC m=+3330.701162926"
Jul 31 22:31:44.633109 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:44.633073    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z" podStartSLOduration=1.633063484 podStartE2EDuration="1.633063484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:31:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:31:44.631907299 +0000 UTC m=+3330.714916103" watchObservedRunningTime="2026-07-31 22:31:44.633063484 +0000 UTC m=+3330.716072347"
Jul 31 22:31:47.127858 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:47.127821    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:31:50.601391 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:50.601359    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:31:55.597938 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:55.597888    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:31:55.598490 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:31:55.597996    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:32:23.204191 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.204158    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"]
Jul 31 22:32:23.204772 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.204422    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" podUID="57c0f21c-a246-4120-85d4-5b4a46a03efe" containerName="maas-api" containerID="cri-o://6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d" gracePeriod=30
Jul 31 22:32:23.261299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.261267    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"]
Jul 31 22:32:23.261545 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.261499    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc" podUID="9a9d305b-3b74-485f-8adb-401936e95cd9" containerName="payload-processing" containerID="cri-o://99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e" gracePeriod=30
Jul 31 22:32:23.266763 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.266736    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"]
Jul 31 22:32:23.266970 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.266935    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z" podUID="41dad2ec-ef39-4151-ae6e-6e0f13dac581" containerName="payload-pre-processing" containerID="cri-o://bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2" gracePeriod=30
Jul 31 22:32:23.513855 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.513829    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:32:23.530715 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.530695    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:32:23.538478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.538456    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:32:23.638149 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638124    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4v7b\" (UniqueName: \"kubernetes.io/projected/9a9d305b-3b74-485f-8adb-401936e95cd9-kube-api-access-v4v7b\") pod \"9a9d305b-3b74-485f-8adb-401936e95cd9\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") "
Jul 31 22:32:23.638325 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638156    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41dad2ec-ef39-4151-ae6e-6e0f13dac581-plugins-config-volume\") pod \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") "
Jul 31 22:32:23.638325 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638174    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z57cv\" (UniqueName: \"kubernetes.io/projected/41dad2ec-ef39-4151-ae6e-6e0f13dac581-kube-api-access-z57cv\") pod \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\" (UID: \"41dad2ec-ef39-4151-ae6e-6e0f13dac581\") "
Jul 31 22:32:23.638325 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638208    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c0f21c-a246-4120-85d4-5b4a46a03efe-openshift-service-ca\") pod \"57c0f21c-a246-4120-85d4-5b4a46a03efe\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") "
Jul 31 22:32:23.638325 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638265    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkhvm\" (UniqueName: \"kubernetes.io/projected/57c0f21c-a246-4120-85d4-5b4a46a03efe-kube-api-access-wkhvm\") pod \"57c0f21c-a246-4120-85d4-5b4a46a03efe\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") "
Jul 31 22:32:23.638607 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638375    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls\") pod \"57c0f21c-a246-4120-85d4-5b4a46a03efe\" (UID: \"57c0f21c-a246-4120-85d4-5b4a46a03efe\") "
Jul 31 22:32:23.638607 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638422    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a9d305b-3b74-485f-8adb-401936e95cd9-plugins-config-volume\") pod \"9a9d305b-3b74-485f-8adb-401936e95cd9\" (UID: \"9a9d305b-3b74-485f-8adb-401936e95cd9\") "
Jul 31 22:32:23.638607 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638555    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41dad2ec-ef39-4151-ae6e-6e0f13dac581-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41dad2ec-ef39-4151-ae6e-6e0f13dac581" (UID: "41dad2ec-ef39-4151-ae6e-6e0f13dac581"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:23.638607 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638566    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c0f21c-a246-4120-85d4-5b4a46a03efe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "57c0f21c-a246-4120-85d4-5b4a46a03efe" (UID: "57c0f21c-a246-4120-85d4-5b4a46a03efe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:23.638865 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638843    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41dad2ec-ef39-4151-ae6e-6e0f13dac581-plugins-config-volume\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.638947 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638868    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57c0f21c-a246-4120-85d4-5b4a46a03efe-openshift-service-ca\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.638947 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.638886    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9d305b-3b74-485f-8adb-401936e95cd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a9d305b-3b74-485f-8adb-401936e95cd9" (UID: "9a9d305b-3b74-485f-8adb-401936e95cd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:23.640529 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.640503    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "57c0f21c-a246-4120-85d4-5b4a46a03efe" (UID: "57c0f21c-a246-4120-85d4-5b4a46a03efe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:32:23.640648 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.640567    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41dad2ec-ef39-4151-ae6e-6e0f13dac581-kube-api-access-z57cv" (OuterVolumeSpecName: "kube-api-access-z57cv") pod "41dad2ec-ef39-4151-ae6e-6e0f13dac581" (UID: "41dad2ec-ef39-4151-ae6e-6e0f13dac581"). InnerVolumeSpecName "kube-api-access-z57cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:32:23.640693 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.640653    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9d305b-3b74-485f-8adb-401936e95cd9-kube-api-access-v4v7b" (OuterVolumeSpecName: "kube-api-access-v4v7b") pod "9a9d305b-3b74-485f-8adb-401936e95cd9" (UID: "9a9d305b-3b74-485f-8adb-401936e95cd9"). InnerVolumeSpecName "kube-api-access-v4v7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:32:23.640693 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.640669    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c0f21c-a246-4120-85d4-5b4a46a03efe-kube-api-access-wkhvm" (OuterVolumeSpecName: "kube-api-access-wkhvm") pod "57c0f21c-a246-4120-85d4-5b4a46a03efe" (UID: "57c0f21c-a246-4120-85d4-5b4a46a03efe"). InnerVolumeSpecName "kube-api-access-wkhvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:32:23.739789 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.739765    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z57cv\" (UniqueName: \"kubernetes.io/projected/41dad2ec-ef39-4151-ae6e-6e0f13dac581-kube-api-access-z57cv\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.739789 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.739789    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkhvm\" (UniqueName: \"kubernetes.io/projected/57c0f21c-a246-4120-85d4-5b4a46a03efe-kube-api-access-wkhvm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.739942 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.739799    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57c0f21c-a246-4120-85d4-5b4a46a03efe-maas-api-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.739942 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.739807    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a9d305b-3b74-485f-8adb-401936e95cd9-plugins-config-volume\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.739942 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.739815    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4v7b\" (UniqueName: \"kubernetes.io/projected/9a9d305b-3b74-485f-8adb-401936e95cd9-kube-api-access-v4v7b\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:23.772270 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.772243    2557 generic.go:356] "Generic (PLEG): container finished" podID="41dad2ec-ef39-4151-ae6e-6e0f13dac581" containerID="bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2" exitCode=0
Jul 31 22:32:23.772379 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.772289    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"
Jul 31 22:32:23.772379 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.772327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z" event={"ID":"41dad2ec-ef39-4151-ae6e-6e0f13dac581","Type":"ContainerDied","Data":"bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2"}
Jul 31 22:32:23.772478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.772380    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z" event={"ID":"41dad2ec-ef39-4151-ae6e-6e0f13dac581","Type":"ContainerDied","Data":"e5ed8d25195c599b9980b002a4c19ede7907af36cd6737e81c51620c8fa1bc04"}
Jul 31 22:32:23.772478 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.772407    2557 scope.go:117] "RemoveContainer" containerID="bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2"
Jul 31 22:32:23.773728 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.773705    2557 generic.go:356] "Generic (PLEG): container finished" podID="9a9d305b-3b74-485f-8adb-401936e95cd9" containerID="99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e" exitCode=0
Jul 31 22:32:23.773823 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.773739    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"
Jul 31 22:32:23.773823 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.773794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc" event={"ID":"9a9d305b-3b74-485f-8adb-401936e95cd9","Type":"ContainerDied","Data":"99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e"}
Jul 31 22:32:23.773945 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.773844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc" event={"ID":"9a9d305b-3b74-485f-8adb-401936e95cd9","Type":"ContainerDied","Data":"5de5a2171f87c6ac204f0384f6a6ff78ed3513aff9a7846c728ae7ec7d46f2a3"}
Jul 31 22:32:23.775155 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.775131    2557 generic.go:356] "Generic (PLEG): container finished" podID="57c0f21c-a246-4120-85d4-5b4a46a03efe" containerID="6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d" exitCode=0
Jul 31 22:32:23.775276 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.775168    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" event={"ID":"57c0f21c-a246-4120-85d4-5b4a46a03efe","Type":"ContainerDied","Data":"6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d"}
Jul 31 22:32:23.775276 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.775181    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"
Jul 31 22:32:23.775276 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.775236    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c" event={"ID":"57c0f21c-a246-4120-85d4-5b4a46a03efe","Type":"ContainerDied","Data":"8c2e0e532eba0adf17e7fbb3ce11b07c9f0f9ded587f3c9658fe1886af0e432d"}
Jul 31 22:32:23.780950 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.780931    2557 scope.go:117] "RemoveContainer" containerID="bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2"
Jul 31 22:32:23.781272 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:32:23.781244    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2\": container with ID starting with bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2 not found: ID does not exist" containerID="bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2"
Jul 31 22:32:23.781408 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.781280    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2"} err="failed to get container status \"bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2\": rpc error: code = NotFound desc = could not find container \"bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2\": container with ID starting with bfc95488c1628aa01262ee89a1baa69082c5e69adeb07d2a86fc1273d73502b2 not found: ID does not exist"
Jul 31 22:32:23.781408 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.781301    2557 scope.go:117] "RemoveContainer" containerID="99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e"
Jul 31 22:32:23.789776 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.789762    2557 scope.go:117] "RemoveContainer" containerID="99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e"
Jul 31 22:32:23.790012 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:32:23.789995    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e\": container with ID starting with 99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e not found: ID does not exist" containerID="99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e"
Jul 31 22:32:23.790063 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.790019    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e"} err="failed to get container status \"99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e\": rpc error: code = NotFound desc = could not find container \"99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e\": container with ID starting with 99c2439322a861a0b19dc2c543af0c58d24e9ece574b0ea607a4ca11b1ef6b7e not found: ID does not exist"
Jul 31 22:32:23.790063 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.790034    2557 scope.go:117] "RemoveContainer" containerID="6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d"
Jul 31 22:32:23.795769 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.795750    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"]
Jul 31 22:32:23.797197 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.797173    2557 scope.go:117] "RemoveContainer" containerID="6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d"
Jul 31 22:32:23.797510 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:32:23.797487    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d\": container with ID starting with 6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d not found: ID does not exist" containerID="6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d"
Jul 31 22:32:23.797643 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.797614    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d"} err="failed to get container status \"6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d\": rpc error: code = NotFound desc = could not find container \"6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d\": container with ID starting with 6345cf04c5f0368290ad95d0633011f0201a0602b4a0c38c3922f496efd0c01d not found: ID does not exist"
Jul 31 22:32:23.799471 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.799450    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-184ad7-7458f884-pnj6z"]
Jul 31 22:32:23.815051 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.815030    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"]
Jul 31 22:32:23.820798 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.820778    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-184ad7-6b9697bd9-p678c"]
Jul 31 22:32:23.830888 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.830869    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"]
Jul 31 22:32:23.832556 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:23.832536    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-184ad7-66478647fd-dzgbc"]
Jul 31 22:32:24.486532 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:24.486506    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41dad2ec-ef39-4151-ae6e-6e0f13dac581" path="/var/lib/kubelet/pods/41dad2ec-ef39-4151-ae6e-6e0f13dac581/volumes"
Jul 31 22:32:24.486873 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:24.486857    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c0f21c-a246-4120-85d4-5b4a46a03efe" path="/var/lib/kubelet/pods/57c0f21c-a246-4120-85d4-5b4a46a03efe/volumes"
Jul 31 22:32:24.487172 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:24.487159    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9d305b-3b74-485f-8adb-401936e95cd9" path="/var/lib/kubelet/pods/9a9d305b-3b74-485f-8adb-401936e95cd9/volumes"
Jul 31 22:32:26.233467 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:26.233435    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:32:47.326516 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:47.326474    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:32:49.249752 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.249717    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"]
Jul 31 22:32:49.250157 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.250029    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8" podUID="45ffc74e-3d5b-41fa-855a-0f09783392cc" containerName="payload-processing" containerID="cri-o://88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d" gracePeriod=30
Jul 31 22:32:49.490263 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.490239    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:32:49.529035 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.528975    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs5mh\" (UniqueName: \"kubernetes.io/projected/45ffc74e-3d5b-41fa-855a-0f09783392cc-kube-api-access-gs5mh\") pod \"45ffc74e-3d5b-41fa-855a-0f09783392cc\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") "
Jul 31 22:32:49.529158 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.529058    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ffc74e-3d5b-41fa-855a-0f09783392cc-plugins-config-volume\") pod \"45ffc74e-3d5b-41fa-855a-0f09783392cc\" (UID: \"45ffc74e-3d5b-41fa-855a-0f09783392cc\") "
Jul 31 22:32:49.529470 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.529446    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ffc74e-3d5b-41fa-855a-0f09783392cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45ffc74e-3d5b-41fa-855a-0f09783392cc" (UID: "45ffc74e-3d5b-41fa-855a-0f09783392cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:32:49.531235 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.531211    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ffc74e-3d5b-41fa-855a-0f09783392cc-kube-api-access-gs5mh" (OuterVolumeSpecName: "kube-api-access-gs5mh") pod "45ffc74e-3d5b-41fa-855a-0f09783392cc" (UID: "45ffc74e-3d5b-41fa-855a-0f09783392cc"). InnerVolumeSpecName "kube-api-access-gs5mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:32:49.629787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.629741    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs5mh\" (UniqueName: \"kubernetes.io/projected/45ffc74e-3d5b-41fa-855a-0f09783392cc-kube-api-access-gs5mh\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:49.629787 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.629781    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45ffc74e-3d5b-41fa-855a-0f09783392cc-plugins-config-volume\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:32:49.893947 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.893858    2557 generic.go:356] "Generic (PLEG): container finished" podID="45ffc74e-3d5b-41fa-855a-0f09783392cc" containerID="88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d" exitCode=0
Jul 31 22:32:49.893947 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.893899    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"
Jul 31 22:32:49.894190 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.893949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8" event={"ID":"45ffc74e-3d5b-41fa-855a-0f09783392cc","Type":"ContainerDied","Data":"88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d"}
Jul 31 22:32:49.894190 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.894019    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8" event={"ID":"45ffc74e-3d5b-41fa-855a-0f09783392cc","Type":"ContainerDied","Data":"15a2688414c5ca0e548d8f6a041b131c1ad64ac35fbf91430386c3b26903f7ce"}
Jul 31 22:32:49.894190 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.894047    2557 scope.go:117] "RemoveContainer" containerID="88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d"
Jul 31 22:32:49.902085 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.902064    2557 scope.go:117] "RemoveContainer" containerID="88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d"
Jul 31 22:32:49.902307 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:32:49.902289    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d\": container with ID starting with 88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d not found: ID does not exist" containerID="88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d"
Jul 31 22:32:49.902373 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.902321    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d"} err="failed to get container status \"88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d\": rpc error: code = NotFound desc = could not find container \"88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d\": container with ID starting with 88c51b96677c5120641a926e966e17b7b15a8dbe58626ef662ea3d9650e7502d not found: ID does not exist"
Jul 31 22:32:49.915111 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.915090    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"]
Jul 31 22:32:49.919205 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:49.919185    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-068335-567649fff6-4d2z8"]
Jul 31 22:32:50.485576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:50.485540    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ffc74e-3d5b-41fa-855a-0f09783392cc" path="/var/lib/kubelet/pods/45ffc74e-3d5b-41fa-855a-0f09783392cc/volumes"
Jul 31 22:32:54.767121 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:54.767080    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"]
Jul 31 22:32:56.225002 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:32:56.224970    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:33:09.786774 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:09.786656    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq" podUID="d28a1369-a5cf-417f-9373-44f7b14c8a80" containerName="main" containerID="cri-o://fa2c40c887994d6d2e1d94b6955689f76b03c6785ff7d802fdbe071bbc70c42c" gracePeriod=45
Jul 31 22:33:09.991477 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:09.991450    2557 generic.go:356] "Generic (PLEG): container finished" podID="d28a1369-a5cf-417f-9373-44f7b14c8a80" containerID="fa2c40c887994d6d2e1d94b6955689f76b03c6785ff7d802fdbe071bbc70c42c" exitCode=0
Jul 31 22:33:09.991601 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:09.991506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq" event={"ID":"d28a1369-a5cf-417f-9373-44f7b14c8a80","Type":"ContainerDied","Data":"fa2c40c887994d6d2e1d94b6955689f76b03c6785ff7d802fdbe071bbc70c42c"}
Jul 31 22:33:10.038768 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.038719    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:33:10.074369 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074345    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-dshm\") pod \"d28a1369-a5cf-417f-9373-44f7b14c8a80\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") "
Jul 31 22:33:10.074504 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074400    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-home\") pod \"d28a1369-a5cf-417f-9373-44f7b14c8a80\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") "
Jul 31 22:33:10.074504 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074439    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28a1369-a5cf-417f-9373-44f7b14c8a80-tls-certs\") pod \"d28a1369-a5cf-417f-9373-44f7b14c8a80\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") "
Jul 31 22:33:10.074504 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074492    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92745\" (UniqueName: \"kubernetes.io/projected/d28a1369-a5cf-417f-9373-44f7b14c8a80-kube-api-access-92745\") pod \"d28a1369-a5cf-417f-9373-44f7b14c8a80\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") "
Jul 31 22:33:10.074726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074517    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-tmp-dir\") pod \"d28a1369-a5cf-417f-9373-44f7b14c8a80\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") "
Jul 31 22:33:10.074726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074547    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-model-cache\") pod \"d28a1369-a5cf-417f-9373-44f7b14c8a80\" (UID: \"d28a1369-a5cf-417f-9373-44f7b14c8a80\") "
Jul 31 22:33:10.074726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074669    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-home" (OuterVolumeSpecName: "home") pod "d28a1369-a5cf-417f-9373-44f7b14c8a80" (UID: "d28a1369-a5cf-417f-9373-44f7b14c8a80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:33:10.074885 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074757    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-home\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:33:10.074943 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074901    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d28a1369-a5cf-417f-9373-44f7b14c8a80" (UID: "d28a1369-a5cf-417f-9373-44f7b14c8a80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:33:10.074943 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.074917    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-model-cache" (OuterVolumeSpecName: "model-cache") pod "d28a1369-a5cf-417f-9373-44f7b14c8a80" (UID: "d28a1369-a5cf-417f-9373-44f7b14c8a80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:33:10.077064 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.077038    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28a1369-a5cf-417f-9373-44f7b14c8a80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d28a1369-a5cf-417f-9373-44f7b14c8a80" (UID: "d28a1369-a5cf-417f-9373-44f7b14c8a80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:33:10.077180 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.077081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-dshm" (OuterVolumeSpecName: "dshm") pod "d28a1369-a5cf-417f-9373-44f7b14c8a80" (UID: "d28a1369-a5cf-417f-9373-44f7b14c8a80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:33:10.077180 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.077097    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28a1369-a5cf-417f-9373-44f7b14c8a80-kube-api-access-92745" (OuterVolumeSpecName: "kube-api-access-92745") pod "d28a1369-a5cf-417f-9373-44f7b14c8a80" (UID: "d28a1369-a5cf-417f-9373-44f7b14c8a80"). InnerVolumeSpecName "kube-api-access-92745". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:33:10.175571 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.175551    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28a1369-a5cf-417f-9373-44f7b14c8a80-tls-certs\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:33:10.175571 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.175571    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92745\" (UniqueName: \"kubernetes.io/projected/d28a1369-a5cf-417f-9373-44f7b14c8a80-kube-api-access-92745\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:33:10.175697 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.175581    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-tmp-dir\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:33:10.175697 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.175590    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-model-cache\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:33:10.175697 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.175597    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28a1369-a5cf-417f-9373-44f7b14c8a80-dshm\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:33:10.997256 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.997232    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"
Jul 31 22:33:10.997256 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.997247    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq" event={"ID":"d28a1369-a5cf-417f-9373-44f7b14c8a80","Type":"ContainerDied","Data":"24045657196f3fc5df5d46401f831c45a60544e68cb3154095915db4f3ef6cab"}
Jul 31 22:33:10.997775 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:10.997298    2557 scope.go:117] "RemoveContainer" containerID="fa2c40c887994d6d2e1d94b6955689f76b03c6785ff7d802fdbe071bbc70c42c"
Jul 31 22:33:11.014112 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:11.014086    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"]
Jul 31 22:33:11.017568 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:11.017543    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-068335/ipp-route-068335-kserve-578cd4fbcf-qlrjq"]
Jul 31 22:33:12.486162 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:33:12.486127    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28a1369-a5cf-417f-9373-44f7b14c8a80" path="/var/lib/kubelet/pods/d28a1369-a5cf-417f-9373-44f7b14c8a80/volumes"
Jul 31 22:34:03.081458 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.081426    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"]
Jul 31 22:34:03.082035 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.081636    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h" podUID="2cef7a1a-9694-460f-85ae-5dbae2d45c8b" containerName="maas-api" containerID="cri-o://d6ff60ee7c200f52a6d48a701260c0c54facf9d3a56b5b4a2387a555f42a7dc6" gracePeriod=30
Jul 31 22:34:03.138614 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.138586    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"]
Jul 31 22:34:03.138824 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.138783    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf" podUID="6b739a58-d798-49a2-a790-5bfcff62dcc8" containerName="payload-processing" containerID="cri-o://2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba" gracePeriod=30
Jul 31 22:34:03.146469 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.146439    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"]
Jul 31 22:34:03.146653 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.146619    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj" podUID="d91b710c-1924-4912-8d6a-00b2809d1c9b" containerName="payload-pre-processing" containerID="cri-o://cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c" gracePeriod=30
Jul 31 22:34:03.236456 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.236430    2557 generic.go:356] "Generic (PLEG): container finished" podID="2cef7a1a-9694-460f-85ae-5dbae2d45c8b" containerID="d6ff60ee7c200f52a6d48a701260c0c54facf9d3a56b5b4a2387a555f42a7dc6" exitCode=0
Jul 31 22:34:03.236565 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.236483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h" event={"ID":"2cef7a1a-9694-460f-85ae-5dbae2d45c8b","Type":"ContainerDied","Data":"d6ff60ee7c200f52a6d48a701260c0c54facf9d3a56b5b4a2387a555f42a7dc6"}
Jul 31 22:34:03.413519 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.413495    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:34:03.415481 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.415463    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:34:03.427349 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.427330    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:34:03.567403 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567372    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d91b710c-1924-4912-8d6a-00b2809d1c9b-plugins-config-volume\") pod \"d91b710c-1924-4912-8d6a-00b2809d1c9b\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") "
Jul 31 22:34:03.567558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567421    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b739a58-d798-49a2-a790-5bfcff62dcc8-plugins-config-volume\") pod \"6b739a58-d798-49a2-a790-5bfcff62dcc8\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") "
Jul 31 22:34:03.567558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567447    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmjrj\" (UniqueName: \"kubernetes.io/projected/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-kube-api-access-cmjrj\") pod \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") "
Jul 31 22:34:03.567558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567470    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-maas-api-tls\") pod \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") "
Jul 31 22:34:03.567558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567495    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbks8\" (UniqueName: \"kubernetes.io/projected/d91b710c-1924-4912-8d6a-00b2809d1c9b-kube-api-access-lbks8\") pod \"d91b710c-1924-4912-8d6a-00b2809d1c9b\" (UID: \"d91b710c-1924-4912-8d6a-00b2809d1c9b\") "
Jul 31 22:34:03.567558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567526    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtzzx\" (UniqueName: \"kubernetes.io/projected/6b739a58-d798-49a2-a790-5bfcff62dcc8-kube-api-access-jtzzx\") pod \"6b739a58-d798-49a2-a790-5bfcff62dcc8\" (UID: \"6b739a58-d798-49a2-a790-5bfcff62dcc8\") "
Jul 31 22:34:03.567558 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567558    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-openshift-service-ca\") pod \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\" (UID: \"2cef7a1a-9694-460f-85ae-5dbae2d45c8b\") "
Jul 31 22:34:03.567874 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567789    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b739a58-d798-49a2-a790-5bfcff62dcc8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b739a58-d798-49a2-a790-5bfcff62dcc8" (UID: "6b739a58-d798-49a2-a790-5bfcff62dcc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:03.567874 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.567794    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91b710c-1924-4912-8d6a-00b2809d1c9b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d91b710c-1924-4912-8d6a-00b2809d1c9b" (UID: "d91b710c-1924-4912-8d6a-00b2809d1c9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:03.568087 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.568068    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cef7a1a-9694-460f-85ae-5dbae2d45c8b" (UID: "2cef7a1a-9694-460f-85ae-5dbae2d45c8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:03.569608 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.569580    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cef7a1a-9694-460f-85ae-5dbae2d45c8b" (UID: "2cef7a1a-9694-460f-85ae-5dbae2d45c8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:34:03.569608 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.569590    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b739a58-d798-49a2-a790-5bfcff62dcc8-kube-api-access-jtzzx" (OuterVolumeSpecName: "kube-api-access-jtzzx") pod "6b739a58-d798-49a2-a790-5bfcff62dcc8" (UID: "6b739a58-d798-49a2-a790-5bfcff62dcc8"). InnerVolumeSpecName "kube-api-access-jtzzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:03.569855 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.569840    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d91b710c-1924-4912-8d6a-00b2809d1c9b-kube-api-access-lbks8" (OuterVolumeSpecName: "kube-api-access-lbks8") pod "d91b710c-1924-4912-8d6a-00b2809d1c9b" (UID: "d91b710c-1924-4912-8d6a-00b2809d1c9b"). InnerVolumeSpecName "kube-api-access-lbks8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:03.569895 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.569858    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-kube-api-access-cmjrj" (OuterVolumeSpecName: "kube-api-access-cmjrj") pod "2cef7a1a-9694-460f-85ae-5dbae2d45c8b" (UID: "2cef7a1a-9694-460f-85ae-5dbae2d45c8b"). InnerVolumeSpecName "kube-api-access-cmjrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:34:03.668463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668407    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-maas-api-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:03.668463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668428    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbks8\" (UniqueName: \"kubernetes.io/projected/d91b710c-1924-4912-8d6a-00b2809d1c9b-kube-api-access-lbks8\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:03.668463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668438    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtzzx\" (UniqueName: \"kubernetes.io/projected/6b739a58-d798-49a2-a790-5bfcff62dcc8-kube-api-access-jtzzx\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:03.668463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668446    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-openshift-service-ca\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:03.668463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668454    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d91b710c-1924-4912-8d6a-00b2809d1c9b-plugins-config-volume\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:03.668463 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668463    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b739a58-d798-49a2-a790-5bfcff62dcc8-plugins-config-volume\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:03.668697 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:03.668470    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmjrj\" (UniqueName: \"kubernetes.io/projected/2cef7a1a-9694-460f-85ae-5dbae2d45c8b-kube-api-access-cmjrj\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:04.241795 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.241772    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"
Jul 31 22:34:04.242196 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.241771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h" event={"ID":"2cef7a1a-9694-460f-85ae-5dbae2d45c8b","Type":"ContainerDied","Data":"26b807a47133eb08254b4bd9401b507c6fffda537682abab1f7589eb5d025f1d"}
Jul 31 22:34:04.242196 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.241924    2557 scope.go:117] "RemoveContainer" containerID="d6ff60ee7c200f52a6d48a701260c0c54facf9d3a56b5b4a2387a555f42a7dc6"
Jul 31 22:34:04.243212 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.243052    2557 generic.go:356] "Generic (PLEG): container finished" podID="6b739a58-d798-49a2-a790-5bfcff62dcc8" containerID="2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba" exitCode=0
Jul 31 22:34:04.243212 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.243091    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"
Jul 31 22:34:04.243212 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.243152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf" event={"ID":"6b739a58-d798-49a2-a790-5bfcff62dcc8","Type":"ContainerDied","Data":"2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba"}
Jul 31 22:34:04.243212 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.243204    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf" event={"ID":"6b739a58-d798-49a2-a790-5bfcff62dcc8","Type":"ContainerDied","Data":"7401e95093eb0b35a8976dd3725e12bf2672ae538bb1afef4a473fdf0757e4d3"}
Jul 31 22:34:04.244601 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.244577    2557 generic.go:356] "Generic (PLEG): container finished" podID="d91b710c-1924-4912-8d6a-00b2809d1c9b" containerID="cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c" exitCode=0
Jul 31 22:34:04.244719 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.244614    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"
Jul 31 22:34:04.244719 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.244624    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj" event={"ID":"d91b710c-1924-4912-8d6a-00b2809d1c9b","Type":"ContainerDied","Data":"cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c"}
Jul 31 22:34:04.244719 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.244664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj" event={"ID":"d91b710c-1924-4912-8d6a-00b2809d1c9b","Type":"ContainerDied","Data":"6f1ad3b327bd2af7f5e57216df22321264ff4aafbe9f58c4895867e72f50e692"}
Jul 31 22:34:04.255794 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.255776    2557 scope.go:117] "RemoveContainer" containerID="2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba"
Jul 31 22:34:04.263309 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.263288    2557 scope.go:117] "RemoveContainer" containerID="2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba"
Jul 31 22:34:04.263561 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:34:04.263544    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba\": container with ID starting with 2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba not found: ID does not exist" containerID="2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba"
Jul 31 22:34:04.263656 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.263568    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba"} err="failed to get container status \"2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba\": rpc error: code = NotFound desc = could not find container \"2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba\": container with ID starting with 2e5107d4b602e24f31ef5e0da86574f6446ea7057156a43261f27304d3f68aba not found: ID does not exist"
Jul 31 22:34:04.263656 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.263584    2557 scope.go:117] "RemoveContainer" containerID="cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c"
Jul 31 22:34:04.268421 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.268400    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"]
Jul 31 22:34:04.270398 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.270385    2557 scope.go:117] "RemoveContainer" containerID="cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c"
Jul 31 22:34:04.270634 ip-10-0-142-220 kubenswrapper[2557]: E0731 22:34:04.270618    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c\": container with ID starting with cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c not found: ID does not exist" containerID="cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c"
Jul 31 22:34:04.270682 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.270639    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c"} err="failed to get container status \"cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c\": rpc error: code = NotFound desc = could not find container \"cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c\": container with ID starting with cd616f8f408c65ddc2b06085b0e6ae5eda749938da5dfa0ce3ecfe628f87162c not found: ID does not exist"
Jul 31 22:34:04.274716 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.274694    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-a88a46-76b74d5ccb-7np7h"]
Jul 31 22:34:04.283934 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.283912    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"]
Jul 31 22:34:04.287561 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.287543    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a88a46-dbb467b44-7d8rf"]
Jul 31 22:34:04.297565 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.297547    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"]
Jul 31 22:34:04.303111 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.303093    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a88a46-795494dc96-6f8vj"]
Jul 31 22:34:04.485615 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.485593    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cef7a1a-9694-460f-85ae-5dbae2d45c8b" path="/var/lib/kubelet/pods/2cef7a1a-9694-460f-85ae-5dbae2d45c8b/volumes"
Jul 31 22:34:04.485909 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.485896    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b739a58-d798-49a2-a790-5bfcff62dcc8" path="/var/lib/kubelet/pods/6b739a58-d798-49a2-a790-5bfcff62dcc8/volumes"
Jul 31 22:34:04.486222 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:04.486210    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d91b710c-1924-4912-8d6a-00b2809d1c9b" path="/var/lib/kubelet/pods/d91b710c-1924-4912-8d6a-00b2809d1c9b/volumes"
Jul 31 22:34:05.728946 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:05.728910    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:34:10.162153 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162121    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"]
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162394    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cef7a1a-9694-460f-85ae-5dbae2d45c8b" containerName="maas-api"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162404    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cef7a1a-9694-460f-85ae-5dbae2d45c8b" containerName="maas-api"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162413    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41dad2ec-ef39-4151-ae6e-6e0f13dac581" containerName="payload-pre-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162419    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="41dad2ec-ef39-4151-ae6e-6e0f13dac581" containerName="payload-pre-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162427    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ffc74e-3d5b-41fa-855a-0f09783392cc" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162432    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ffc74e-3d5b-41fa-855a-0f09783392cc" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162439    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28a1369-a5cf-417f-9373-44f7b14c8a80" containerName="main"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162446    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28a1369-a5cf-417f-9373-44f7b14c8a80" containerName="main"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162453    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b739a58-d798-49a2-a790-5bfcff62dcc8" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162458    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b739a58-d798-49a2-a790-5bfcff62dcc8" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162465    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91b710c-1924-4912-8d6a-00b2809d1c9b" containerName="payload-pre-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162471    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91b710c-1924-4912-8d6a-00b2809d1c9b" containerName="payload-pre-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162476    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9d305b-3b74-485f-8adb-401936e95cd9" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162481    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9d305b-3b74-485f-8adb-401936e95cd9" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162487    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c0f21c-a246-4120-85d4-5b4a46a03efe" containerName="maas-api"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162492    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c0f21c-a246-4120-85d4-5b4a46a03efe" containerName="maas-api"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162538    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ffc74e-3d5b-41fa-855a-0f09783392cc" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162546    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cef7a1a-9694-460f-85ae-5dbae2d45c8b" containerName="maas-api"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162552    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b739a58-d798-49a2-a790-5bfcff62dcc8" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162558    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91b710c-1924-4912-8d6a-00b2809d1c9b" containerName="payload-pre-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162563    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c0f21c-a246-4120-85d4-5b4a46a03efe" containerName="maas-api"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162569    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="41dad2ec-ef39-4151-ae6e-6e0f13dac581" containerName="payload-pre-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162573    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9d305b-3b74-485f-8adb-401936e95cd9" containerName="payload-processing"
Jul 31 22:34:10.162576 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.162579    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28a1369-a5cf-417f-9373-44f7b14c8a80" containerName="main"
Jul 31 22:34:10.167133 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.167116    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:10.170522 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.170500    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:34:10.170655 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.170539    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:34:10.180290 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.180261    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"]
Jul 31 22:34:10.211872 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.211847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ee9929-6m628\" (UID: \"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:10.312309 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.312287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ee9929-6m628\" (UID: \"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:10.312813 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.312795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ee9929-6m628\" (UID: \"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:10.476772 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.476743    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:10.802699 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:10.802677    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"]
Jul 31 22:34:10.804796 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:34:10.804774    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d881a8_93ae_4d7c_95d2_f2de7d8da33a.slice/crio-600705f5e6883078549b6623a60a8d3d20c1d3a2cf749ba80ddedf2bb02545e9 WatchSource:0}: Error finding container 600705f5e6883078549b6623a60a8d3d20c1d3a2cf749ba80ddedf2bb02545e9: Status 404 returned error can't find the container with id 600705f5e6883078549b6623a60a8d3d20c1d3a2cf749ba80ddedf2bb02545e9
Jul 31 22:34:11.283178 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:11.283139    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628" event={"ID":"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a","Type":"ContainerStarted","Data":"cae57b51d0b1a063accc552e097c548d597313b2ffb80208042ec6d3828746ed"}
Jul 31 22:34:11.283528 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:11.283199    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628" event={"ID":"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a","Type":"ContainerStarted","Data":"600705f5e6883078549b6623a60a8d3d20c1d3a2cf749ba80ddedf2bb02545e9"}
Jul 31 22:34:11.298709 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:11.298666    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628" podStartSLOduration=1.29865342 podStartE2EDuration="1.29865342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:34:11.297408952 +0000 UTC m=+3477.380417755" watchObservedRunningTime="2026-07-31 22:34:11.29865342 +0000 UTC m=+3477.381662220"
Jul 31 22:34:12.289214 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:12.289179    2557 generic.go:356] "Generic (PLEG): container finished" podID="f5d881a8-93ae-4d7c-95d2-f2de7d8da33a" containerID="cae57b51d0b1a063accc552e097c548d597313b2ffb80208042ec6d3828746ed" exitCode=0
Jul 31 22:34:12.289564 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:12.289263    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628" event={"ID":"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a","Type":"ContainerDied","Data":"cae57b51d0b1a063accc552e097c548d597313b2ffb80208042ec6d3828746ed"}
Jul 31 22:34:13.417896 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:13.417870    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:13.435908 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:13.435883    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a-maas-api-service-ca\") pod \"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a\" (UID: \"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a\") "
Jul 31 22:34:13.436381 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:13.436351    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5d881a8-93ae-4d7c-95d2-f2de7d8da33a" (UID: "f5d881a8-93ae-4d7c-95d2-f2de7d8da33a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:13.537307 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:13.537277    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a-maas-api-service-ca\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:14.303610 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:14.303573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628" event={"ID":"f5d881a8-93ae-4d7c-95d2-f2de7d8da33a","Type":"ContainerDied","Data":"600705f5e6883078549b6623a60a8d3d20c1d3a2cf749ba80ddedf2bb02545e9"}
Jul 31 22:34:14.303812 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:14.303639    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="600705f5e6883078549b6623a60a8d3d20c1d3a2cf749ba80ddedf2bb02545e9"
Jul 31 22:34:14.303812 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:14.303644    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"
Jul 31 22:34:20.744315 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:20.744282    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"]
Jul 31 22:34:20.746813 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:20.746788    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ee9929-6m628"]
Jul 31 22:34:22.485657 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:22.485616    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d881a8-93ae-4d7c-95d2-f2de7d8da33a" path="/var/lib/kubelet/pods/f5d881a8-93ae-4d7c-95d2-f2de7d8da33a/volumes"
Jul 31 22:34:22.929838 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:22.929756    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:34:28.268276 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.268244    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"]
Jul 31 22:34:28.268638 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.268530    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d881a8-93ae-4d7c-95d2-f2de7d8da33a" containerName="revoke-keys"
Jul 31 22:34:28.268638 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.268541    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d881a8-93ae-4d7c-95d2-f2de7d8da33a" containerName="revoke-keys"
Jul 31 22:34:28.268638 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.268592    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d881a8-93ae-4d7c-95d2-f2de7d8da33a" containerName="revoke-keys"
Jul 31 22:34:28.272707 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.272690    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:28.275416 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.275396    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bc8sv\""
Jul 31 22:34:28.275523 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.275399    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:34:28.278825 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.278801    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"]
Jul 31 22:34:28.350043 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.350019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ed89d6-1859-4678-b6a8-ec887a50c7f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp\" (UID: \"73ed89d6-1859-4678-b6a8-ec887a50c7f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:28.450622 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.450598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ed89d6-1859-4678-b6a8-ec887a50c7f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp\" (UID: \"73ed89d6-1859-4678-b6a8-ec887a50c7f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:28.451153 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.451137    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ed89d6-1859-4678-b6a8-ec887a50c7f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp\" (UID: \"73ed89d6-1859-4678-b6a8-ec887a50c7f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:28.584239 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.584186    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:28.704564 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:28.704532    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"]
Jul 31 22:34:28.707565 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:34:28.707531    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ed89d6_1859_4678_b6a8_ec887a50c7f4.slice/crio-0652eb99bf31d1bcf7f9d8873feee22185d9b6e7a399604f3651ce18aed0acfa WatchSource:0}: Error finding container 0652eb99bf31d1bcf7f9d8873feee22185d9b6e7a399604f3651ce18aed0acfa: Status 404 returned error can't find the container with id 0652eb99bf31d1bcf7f9d8873feee22185d9b6e7a399604f3651ce18aed0acfa
Jul 31 22:34:29.365903 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:29.365873    2557 generic.go:356] "Generic (PLEG): container finished" podID="73ed89d6-1859-4678-b6a8-ec887a50c7f4" containerID="5674a1ff6dcce39cc174ae3c49fb894b593f8430b720b5c20ebae4145a9e8bc6" exitCode=0
Jul 31 22:34:29.366233 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:29.365972    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp" event={"ID":"73ed89d6-1859-4678-b6a8-ec887a50c7f4","Type":"ContainerDied","Data":"5674a1ff6dcce39cc174ae3c49fb894b593f8430b720b5c20ebae4145a9e8bc6"}
Jul 31 22:34:29.366233 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:29.366020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp" event={"ID":"73ed89d6-1859-4678-b6a8-ec887a50c7f4","Type":"ContainerStarted","Data":"0652eb99bf31d1bcf7f9d8873feee22185d9b6e7a399604f3651ce18aed0acfa"}
Jul 31 22:34:30.495091 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:30.495061    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:30.565367 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:30.565339    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ed89d6-1859-4678-b6a8-ec887a50c7f4-maas-api-service-ca\") pod \"73ed89d6-1859-4678-b6a8-ec887a50c7f4\" (UID: \"73ed89d6-1859-4678-b6a8-ec887a50c7f4\") "
Jul 31 22:34:30.565661 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:30.565641    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ed89d6-1859-4678-b6a8-ec887a50c7f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73ed89d6-1859-4678-b6a8-ec887a50c7f4" (UID: "73ed89d6-1859-4678-b6a8-ec887a50c7f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:34:30.666764 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:30.666694    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ed89d6-1859-4678-b6a8-ec887a50c7f4-maas-api-service-ca\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\""
Jul 31 22:34:31.375258 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:31.375229    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"
Jul 31 22:34:31.375460 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:31.375223    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp" event={"ID":"73ed89d6-1859-4678-b6a8-ec887a50c7f4","Type":"ContainerDied","Data":"0652eb99bf31d1bcf7f9d8873feee22185d9b6e7a399604f3651ce18aed0acfa"}
Jul 31 22:34:31.375460 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:31.375379    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0652eb99bf31d1bcf7f9d8873feee22185d9b6e7a399604f3651ce18aed0acfa"
Jul 31 22:34:38.849818 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:38.849721    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"]
Jul 31 22:34:38.856355 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:38.856325    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-21e950-29758950-q7cwm"]
Jul 31 22:34:39.025795 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:39.025757    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"]
Jul 31 22:34:39.027757 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:39.027731    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-21e950-hr4dp"]
Jul 31 22:34:40.485934 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:40.485899    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72694462-e741-436e-9e87-d7fa28cd4e08" path="/var/lib/kubelet/pods/72694462-e741-436e-9e87-d7fa28cd4e08/volumes"
Jul 31 22:34:40.486306 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:40.486287    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ed89d6-1859-4678-b6a8-ec887a50c7f4" path="/var/lib/kubelet/pods/73ed89d6-1859-4678-b6a8-ec887a50c7f4/volumes"
Jul 31 22:34:41.019684 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:41.019651    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-zv5br"]
Jul 31 22:34:51.409344 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:51.409315    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8jj42_b4fd4254-c59a-4daa-ade7-91d0f97e5902/manager/0.log"
Jul 31 22:34:51.526571 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:51.526549    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6whzg_7bf611f7-aa84-4ad9-82d9-e80e538f51b5/manager/0.log"
Jul 31 22:34:52.315325 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:52.315289    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-r7m7j_ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff/copy-manifests/0.log"
Jul 31 22:34:52.322099 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:52.322083    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-r7m7j_ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff/manager/0.log"
Jul 31 22:34:54.043548 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:54.043515    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-kjjmz_a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36/manager/0.log"
Jul 31 22:34:54.157499 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:54.157471    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-49ccn_9a605505-a759-441f-81d5-c897353b92aa/manager/0.log"
Jul 31 22:34:54.498000 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:54.497979    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-zv5br_14f7518f-0df5-478a-809e-cd1723c131f6/limitador/0.log"
Jul 31 22:34:54.614278 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:54.614252    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-2fgvp_71f32b33-7766-4bae-bdc6-fcf8fb40ec3e/manager/0.log"
Jul 31 22:34:56.532013 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:56.531983    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmxst9_9aa67ff7-bad1-49a1-89d5-93eef8aff3db/main/0.log"
Jul 31 22:34:56.759794 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:34:56.759771    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-8vdzh_a4282806-db08-4480-bb4b-fcc2131d7ad7/main/0.log"
Jul 31 22:35:02.525672 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.525637    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pm8cl/must-gather-g9p9f"]
Jul 31 22:35:02.526074 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.525926    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ed89d6-1859-4678-b6a8-ec887a50c7f4" containerName="revoke-keys"
Jul 31 22:35:02.526074 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.525937    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ed89d6-1859-4678-b6a8-ec887a50c7f4" containerName="revoke-keys"
Jul 31 22:35:02.526074 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.526003    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ed89d6-1859-4678-b6a8-ec887a50c7f4" containerName="revoke-keys"
Jul 31 22:35:02.528991 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.528942    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.531598 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.531564    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pm8cl\"/\"kube-root-ca.crt\""
Jul 31 22:35:02.531751 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.531703    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pm8cl\"/\"openshift-service-ca.crt\""
Jul 31 22:35:02.532886 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.532869    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pm8cl\"/\"default-dockercfg-cz62l\""
Jul 31 22:35:02.536700 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.536679    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pm8cl/must-gather-g9p9f"]
Jul 31 22:35:02.604228 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.604204    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/25219013-057e-42e0-9463-27e091c512be-must-gather-output\") pod \"must-gather-g9p9f\" (UID: \"25219013-057e-42e0-9463-27e091c512be\") " pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.604317 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.604230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7r4g\" (UniqueName: \"kubernetes.io/projected/25219013-057e-42e0-9463-27e091c512be-kube-api-access-g7r4g\") pod \"must-gather-g9p9f\" (UID: \"25219013-057e-42e0-9463-27e091c512be\") " pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.704948 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.704925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/25219013-057e-42e0-9463-27e091c512be-must-gather-output\") pod \"must-gather-g9p9f\" (UID: \"25219013-057e-42e0-9463-27e091c512be\") " pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.705045 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.704951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7r4g\" (UniqueName: \"kubernetes.io/projected/25219013-057e-42e0-9463-27e091c512be-kube-api-access-g7r4g\") pod \"must-gather-g9p9f\" (UID: \"25219013-057e-42e0-9463-27e091c512be\") " pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.705232 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.705213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/25219013-057e-42e0-9463-27e091c512be-must-gather-output\") pod \"must-gather-g9p9f\" (UID: \"25219013-057e-42e0-9463-27e091c512be\") " pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.712526 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.712507    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7r4g\" (UniqueName: \"kubernetes.io/projected/25219013-057e-42e0-9463-27e091c512be-kube-api-access-g7r4g\") pod \"must-gather-g9p9f\" (UID: \"25219013-057e-42e0-9463-27e091c512be\") " pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.838730 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.838679    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pm8cl/must-gather-g9p9f"
Jul 31 22:35:02.960670 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.960644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pm8cl/must-gather-g9p9f"]
Jul 31 22:35:02.962439 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:35:02.962405    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25219013_057e_42e0_9463_27e091c512be.slice/crio-ba2689a0dbf3cb413a37a637c5f1449d3614e7182dd5a6a767f30e6c3bfdd8e9 WatchSource:0}: Error finding container ba2689a0dbf3cb413a37a637c5f1449d3614e7182dd5a6a767f30e6c3bfdd8e9: Status 404 returned error can't find the container with id ba2689a0dbf3cb413a37a637c5f1449d3614e7182dd5a6a767f30e6c3bfdd8e9
Jul 31 22:35:02.964269 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:02.964251    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:35:03.514178 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:03.514150    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/must-gather-g9p9f" event={"ID":"25219013-057e-42e0-9463-27e091c512be","Type":"ContainerStarted","Data":"ba2689a0dbf3cb413a37a637c5f1449d3614e7182dd5a6a767f30e6c3bfdd8e9"}
Jul 31 22:35:04.521952 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:04.521209    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/must-gather-g9p9f" event={"ID":"25219013-057e-42e0-9463-27e091c512be","Type":"ContainerStarted","Data":"db1fcf0b61fecc3a108d323618bf363456f8e60b3dda2c53f26b9657a5a910d4"}
Jul 31 22:35:04.521952 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:04.521259    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/must-gather-g9p9f" event={"ID":"25219013-057e-42e0-9463-27e091c512be","Type":"ContainerStarted","Data":"537d37f58db38cb120dbadc3a6b1883ba12b6fce51ba8f1a7df29792f50d2dc6"}
Jul 31 22:35:04.538950 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:04.538897    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pm8cl/must-gather-g9p9f" podStartSLOduration=1.239774986 podStartE2EDuration="2.538884178s" totalImagesPullingTime="1.299109192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:35:04.53770076 +0000 UTC m=+3530.620709565" watchObservedRunningTime="2026-07-31 22:35:04.538884178 +0000 UTC m=+3530.621892982"
Jul 31 22:35:05.767448 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:05.767408    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kv9ct_83b91889-0841-4386-bef9-29bf74a33547/global-pull-secret-syncer/0.log"
Jul 31 22:35:05.926007 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:05.925974    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lx5mt_8467d52a-9653-4ace-850b-987fde89d0dc/konnectivity-agent/0.log"
Jul 31 22:35:06.038995 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:06.038893    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-220.ec2.internal_70a151c6e1ba236684bfa7e6ef9cf985/haproxy/0.log"
Jul 31 22:35:11.380951 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:11.380919    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-kjjmz_a1c86e55-7b8f-4bb8-939d-d20cb2a6ab36/manager/0.log"
Jul 31 22:35:11.418921 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:11.418895    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-49ccn_9a605505-a759-441f-81d5-c897353b92aa/manager/0.log"
Jul 31 22:35:11.567900 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:11.567870    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-zv5br_14f7518f-0df5-478a-809e-cd1723c131f6/limitador/0.log"
Jul 31 22:35:11.665033 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:11.664547    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-2fgvp_71f32b33-7766-4bae-bdc6-fcf8fb40ec3e/manager/0.log"
Jul 31 22:35:13.690726 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:13.690694    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqvr7_57804dd6-670e-43b6-87e1-4c7955b9ab93/node-exporter/0.log"
Jul 31 22:35:13.711248 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:13.711218    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqvr7_57804dd6-670e-43b6-87e1-4c7955b9ab93/kube-rbac-proxy/0.log"
Jul 31 22:35:13.733228 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:13.733198    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rqvr7_57804dd6-670e-43b6-87e1-4c7955b9ab93/init-textfile/0.log"
Jul 31 22:35:15.305629 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.305598    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-xszjk_056ca5da-db6a-4896-899a-a467579b23c5/networking-console-plugin/0.log"
Jul 31 22:35:15.454676 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.454643    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"]
Jul 31 22:35:15.463019 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.462992    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.468448 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.467737    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"]
Jul 31 22:35:15.623268 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.623180    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-lib-modules\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.623535 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.623512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzk65\" (UniqueName: \"kubernetes.io/projected/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-kube-api-access-vzk65\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.623762 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.623742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-sys\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.623908 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.623892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-proc\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.624068 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.624051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-podres\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.724858 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.724805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzk65\" (UniqueName: \"kubernetes.io/projected/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-kube-api-access-vzk65\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725072 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.724912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-sys\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725072 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.724941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-proc\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725072 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.724983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-podres\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725072 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.725040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-lib-modules\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725295 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.725204    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-lib-modules\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725471 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.725446    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-proc\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725620 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.725604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-sys\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.725718 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.725631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-podres\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.733638 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.733548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzk65\" (UniqueName: \"kubernetes.io/projected/b5fde3ed-9e45-4de9-add9-1f32eb32a94f-kube-api-access-vzk65\") pod \"perf-node-gather-daemonset-fl5hn\" (UID: \"b5fde3ed-9e45-4de9-add9-1f32eb32a94f\") " pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.780759 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.780716    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:15.958600 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:15.958513    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"]
Jul 31 22:35:15.964592 ip-10-0-142-220 kubenswrapper[2557]: W0731 22:35:15.964482    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb5fde3ed_9e45_4de9_add9_1f32eb32a94f.slice/crio-5403545033b00e6148d62f8c13d6b00c8ac35ec9d6dccba4f7b12723a2cf00b9 WatchSource:0}: Error finding container 5403545033b00e6148d62f8c13d6b00c8ac35ec9d6dccba4f7b12723a2cf00b9: Status 404 returned error can't find the container with id 5403545033b00e6148d62f8c13d6b00c8ac35ec9d6dccba4f7b12723a2cf00b9
Jul 31 22:35:16.600814 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:16.600771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn" event={"ID":"b5fde3ed-9e45-4de9-add9-1f32eb32a94f","Type":"ContainerStarted","Data":"b94e2801310a2ae9b58940ef16d10655ef6bc63768e1d53783e60ded6301d953"}
Jul 31 22:35:16.601299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:16.600832    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn" event={"ID":"b5fde3ed-9e45-4de9-add9-1f32eb32a94f","Type":"ContainerStarted","Data":"5403545033b00e6148d62f8c13d6b00c8ac35ec9d6dccba4f7b12723a2cf00b9"}
Jul 31 22:35:16.601299 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:16.600935    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:16.617983 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:16.617898    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn" podStartSLOduration=1.617878175 podStartE2EDuration="1.617878175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:35:16.616359615 +0000 UTC m=+3542.699368420" watchObservedRunningTime="2026-07-31 22:35:16.617878175 +0000 UTC m=+3542.700886979"
Jul 31 22:35:18.104285 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:18.104256    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rt8z4_3450f80f-b1df-4fd3-b807-784ac3cbcdd1/dns/0.log"
Jul 31 22:35:18.124588 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:18.124568    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rt8z4_3450f80f-b1df-4fd3-b807-784ac3cbcdd1/kube-rbac-proxy/0.log"
Jul 31 22:35:18.229774 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:18.229743    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z29n6_e26873ec-3dc3-4972-9966-c7ab244be462/dns-node-resolver/0.log"
Jul 31 22:35:18.767601 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:18.767571    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ntbwp_8e7010c1-229b-46d3-85f2-ce1e92ab2d46/node-ca/0.log"
Jul 31 22:35:20.856239 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:20.856208    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v9phl_d26c839e-e9b1-4a26-98ba-3a55239e7e96/serve-healthcheck-canary/0.log"
Jul 31 22:35:21.385927 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:21.385893    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dkgq2_ead0a0c8-0dbb-4679-82b4-f09325572918/kube-rbac-proxy/0.log"
Jul 31 22:35:21.405679 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:21.405653    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dkgq2_ead0a0c8-0dbb-4679-82b4-f09325572918/exporter/0.log"
Jul 31 22:35:21.426494 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:21.426470    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dkgq2_ead0a0c8-0dbb-4679-82b4-f09325572918/extractor/0.log"
Jul 31 22:35:22.620413 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:22.619512    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pm8cl/perf-node-gather-daemonset-fl5hn"
Jul 31 22:35:23.483674 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:23.483648    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8jj42_b4fd4254-c59a-4daa-ade7-91d0f97e5902/manager/0.log"
Jul 31 22:35:23.791227 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:23.791153    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6whzg_7bf611f7-aa84-4ad9-82d9-e80e538f51b5/manager/0.log"
Jul 31 22:35:24.444288 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:24.444259    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-r7m7j_ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff/manager/0.log"
Jul 31 22:35:24.467029 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:24.466998    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67685b9c4d-r7m7j_ff2b9ca8-7a4c-4ff3-ad17-0e6a69d317ff/copy-manifests/0.log"
Jul 31 22:35:25.781875 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:25.781849    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bf58c775b-gkrdm_949da123-89a5-4645-8cc4-a6598b339ba5/manager/0.log"
Jul 31 22:35:31.784061 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.784031    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/kube-multus-additional-cni-plugins/0.log"
Jul 31 22:35:31.805477 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.805456    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/egress-router-binary-copy/0.log"
Jul 31 22:35:31.826759 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.826730    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/cni-plugins/0.log"
Jul 31 22:35:31.848775 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.848752    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/bond-cni-plugin/0.log"
Jul 31 22:35:31.868744 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.868721    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/routeoverride-cni/0.log"
Jul 31 22:35:31.889529 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.889508    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/whereabouts-cni-bincopy/0.log"
Jul 31 22:35:31.910266 ip-10-0-142-220 kubenswrapper[2557]: I0731 22:35:31.910246    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5dtwt_063389fa-2772-4bfc-b51a-1d25255c9a16/whereabouts-cni/0.log"