Jul 06 19:22:58.650977 ip-10-0-140-210 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:22:58.650993 ip-10-0-140-210 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:22:58.651003 ip-10-0-140-210 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:22:58.651449 ip-10-0-140-210 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:23:08.743478 ip-10-0-140-210 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:23:08.743503 ip-10-0-140-210 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d3981b57fcea4dc2a4f8dca5cb244b59 --
Jul 06 19:25:09.360729 ip-10-0-140-210 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:25:10.991237 ip-10-0-140-210 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:25:10.991237 ip-10-0-140-210 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:25:10.991237 ip-10-0-140-210 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:25:10.991237 ip-10-0-140-210 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:25:10.991237 ip-10-0-140-210 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:25:10.993890 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:10.993772    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:25:11.000318 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000292    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:11.000318 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000314    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:11.000318 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000319    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:11.000318 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000321    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:11.000318 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000325    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000329    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000332    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000335    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000338    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000340    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000343    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000346    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000348    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000351    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000353    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000356    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000359    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000361    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000364    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000366    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000369    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000374    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000378    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000382    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:11.000520 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000384    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000390    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000394    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000398    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000401    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000404    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000406    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000409    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000411    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000414    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000416    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000419    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000421    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000424    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000428    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000431    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000433    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000436    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000439    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000441    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:11.000985 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000444    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000446    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000449    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000451    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000454    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000457    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000460    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000463    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000465    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000468    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000471    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000473    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000476    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000478    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000481    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000483    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000486    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000488    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000491    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:11.001484 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000493    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000496    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000498    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000501    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000503    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000506    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000509    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000513    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000515    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000519    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000521    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000524    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000527    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000529    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000532    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000536    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000539    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000541    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000543    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000546    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:11.001919 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000554    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000557    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000560    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000562    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000565    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000567    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000570    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000572    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000575    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000577    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000580    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000583    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000587    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000590    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000592    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.000595    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001334    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001342    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001345    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001348    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:11.002403 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001351    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001354    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001357    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001359    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001362    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001364    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001367    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001369    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001372    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001374    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001377    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001380    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001382    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001386    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001389    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001391    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001396    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001400    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001403    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:11.002904 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001405    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001409    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001411    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001414    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001416    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001419    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001422    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001425    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001428    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001431    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001433    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001436    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001439    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001443    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001447    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001450    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001453    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001457    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001459    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:11.003389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001462    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001465    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001467    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001471    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001473    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001476    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001478    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001481    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001484    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001487    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001490    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001492    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001495    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001497    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001500    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001502    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001505    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001507    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001509    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001512    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:11.003843 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001514    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001517    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001519    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001522    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001524    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001527    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001530    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001533    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001535    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001538    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001541    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001543    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001546    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001548    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001550    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001553    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001555    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001558    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001561    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:11.004347 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001564    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001567    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001570    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001573    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001575    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001578    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001580    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001583    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001586    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001589    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001592    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001594    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001596    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001599    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001601    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001604    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001607    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.001609    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002019    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002025    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:11.004816 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002028    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002031    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002034    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002037    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002040    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002043    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002045    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002048    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002052    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002055    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002057    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002060    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002063    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002065    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002068    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002071    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002074    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002076    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002078    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002081    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:11.005339 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002084    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002087    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002089    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002091    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002094    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002097    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002099    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002117    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002120    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002122    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002126    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002128    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002131    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002133    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002135    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002138    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002140    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002145    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002148    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:11.005812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002151    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002155    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002159    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002161    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002164    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002167    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002169    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002172    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002178    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002180    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002183    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002185    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002187    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002190    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002192    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002195    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002197    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002202    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002205    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002208    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:11.006284 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002211    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002213    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002216    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002219    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002221    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002224    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002227    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002229    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002232    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002234    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002237    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002239    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002241    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002245    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002248    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002250    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002253    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002255    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002258    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002260    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:11.006761 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002263    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002266    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002268    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002271    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002273    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002277    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002280    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002282    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002285    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002287    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002289    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002292    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002295    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002297    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002300    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002302    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002305    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.002309    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002380    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002388    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:25:11.007243 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002397    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002404    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002410    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002415    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002421    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002428    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002432    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002436    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002439    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002442    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002445    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002448    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002451    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002454    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002458    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002461    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002465    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002468    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002471    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002474    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002477    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002481    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002484    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:25:11.007712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002487    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002490    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002493    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002496    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002499    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002503    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002505    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002509    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002512    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002515    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002518    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002521    2579 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002525    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002530    2579 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002533    2579 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002536    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002539    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002542    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002551    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002554    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002557    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002560    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002563    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002566    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002570    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:25:11.008256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002572    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002585    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002588    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002591    2579 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002596    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002599    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002601    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002604    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002607    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002611    2579 flags.go:64] FLAG: --help="false"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002613    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002620    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002623    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002626    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002629    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002633    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002636    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002638    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002641    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002644    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002647    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002650    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002653    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002656    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:25:11.008883 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002659    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002662    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002665    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002668    2579 flags.go:64] FLAG: --lock-file=""
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002671    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002674    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002676    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002682    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002685    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002688    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002691    2579 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002694    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002697    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002700    2579 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002703    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002707    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002710    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002714    2579 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002716    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002721    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002724    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002727    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002730    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002733    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002736    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:25:11.009466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002742    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002745    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002749    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002752    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002754    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002760    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002762    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002765    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002768    2579 flags.go:64] FLAG: --port="10250"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002771    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002774    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b6e0fa746941429d"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002778    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002781    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002783    2579 flags.go:64] FLAG: --register-node="true"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002786    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002790    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002793    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002796    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002799    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002802    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002806    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002809    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002812    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002815    2579 flags.go:64] FLAG: --runonce="false"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002818    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:25:11.010078 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002821    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002824    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002828    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002831    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002834    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002837    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002840    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002843    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002846    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002850    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002853    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002856    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002859    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002862    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002867    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002870    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002873    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002877    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002879    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002882    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002885    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002888    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002891    2579 flags.go:64] FLAG: --v="2"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002895    2579 flags.go:64] FLAG: --version="false"
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002900    2579 flags.go:64] FLAG: --vmodule=""
Jul 06 19:25:11.010737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002903    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.002907    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003030    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003034    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003036    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003039    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003042    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003045    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003048    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003052    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003054    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003057    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003060    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003063    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003065    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003068    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003071    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003074    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003077    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003079    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003082    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:11.011335 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003084    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003087    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003089    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003092    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003095    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003097    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003099    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003116    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003118    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003121    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003123    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003132    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003135    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003138    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003140    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003143    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003147    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003151    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003153    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:11.011837 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003156    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003160    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003163    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003166    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003169    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003172    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003175    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003178    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003182    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003185    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003188    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003190    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003193    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003195    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003198    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003201    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003203    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003206    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003209    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003212    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:11.012344 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003214    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003217    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003219    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003221    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003225    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003229    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003232    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003235    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003237    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003240    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003243    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003246    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003250    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003255    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003259    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003262    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003265    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003267    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003270    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:11.012812 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003272    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003276    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003279    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003281    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003284    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003287    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003289    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003292    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003294    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003297    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003300    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003302    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003305    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003307    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003310    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003312    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003319    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003322    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003325    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003328    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:11.013271 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003330    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.003333    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.003338    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.010731    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.010748    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.010767    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.010776    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010830    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010836    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010839    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010842    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010845    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010849    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010852    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:11.013739 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010854    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010857    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010859    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010862    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010865    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010868    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010870    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010873    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010875    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010878    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010881    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010883    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010886    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010888    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010892    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010895    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010899    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010903    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010906    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:11.014079 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010909    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010912    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010914    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010919    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010921    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010924    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010927    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010929    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010932    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010934    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010937    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010940    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010942    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010944    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010947    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010950    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010952    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010955    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010957    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010959    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:11.014606 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010962    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010965    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010967    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010971    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010974    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010976    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010980    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010982    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010984    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010987    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010989    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010992    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010995    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.010997    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011000    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011003    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011006    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011009    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011011    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:11.015080 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011014    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011016    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011019    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011021    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011024    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011026    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011029    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011031    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011034    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011036    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011039    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011041    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011043    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011046    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011049    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011051    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011054    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011057    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011059    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011062    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:11.015533 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011064    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011067    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011069    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011071    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011074    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011076    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011079    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011081    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011084    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011087    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011090    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011093    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011095    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011097    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.011115    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:25:11.015987 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011232    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011237    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011240    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011242    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011246    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011249    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011251    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011254    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011257    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011260    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011263    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011266    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011269    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011271    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011274    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011277    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011279    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011282    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011285    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011287    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:25:11.016375 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011289    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011292    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011294    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011297    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011300    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011302    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011305    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011307    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011310    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011313    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011315    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011319    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011323    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011326    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011329    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011333    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011335    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011338    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011341    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:25:11.016849 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011344    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011347    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011350    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011353    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011355    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011358    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011361    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011363    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011366    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011368    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011370    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011373    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011375    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011378    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011380    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011383    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011385    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011388    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011390    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011393    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:25:11.017311 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011395    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011398    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011401    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011404    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011406    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011408    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011411    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011413    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011416    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011418    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011420    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011423    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011425    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011428    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011430    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011433    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011435    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011438    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011441    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:25:11.017769 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011443    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011446    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011448    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011450    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011453    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011455    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011458    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011460    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011463    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011465    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011468    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011470    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011473    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011476    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011480    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011482    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011487    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011489    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011492    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011494    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:25:11.018294 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:11.011497    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.011502    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.011605    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.013586    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.015266    2579 server.go:1019] "Starting client certificate rotation"
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.015371    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.015405    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:25:11.018960 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.017849    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:25:11.022248 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.022226    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:25:11.031002 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.030989    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:25:11.034296 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.034277    2579 log.go:25] "Validated CRI v1 image API"
Jul 06 19:25:11.035918 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.035899    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:25:11.039498 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.039479    2579 fs.go:135] Filesystem UUIDs: map[3a9b7698-7734-4a0c-bf1b-cd728e780788:/dev/nvme0n1p4 3fda5d07-ca42-43b8-854e-297b02f031a9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 19:25:11.039546 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.039499    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:25:11.045317 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.045208    2579 manager.go:216] Machine: {Timestamp:2026-07-06 19:25:11.043905126 +0000 UTC m=+0.362074304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098918 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2091a367b80235b0087b4d2c923dfe SystemUUID:ec2091a3-67b8-0235-b008-7b4d2c923dfe BootID:d3981b57-fcea-4dc2-a4f8-dca5cb244b59 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:b0:77:b4:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:b0:77:b4:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:be:67:36:82:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:25:11.045317 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.045312    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:25:11.045443 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.045389    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:25:11.046346 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.046326    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:25:11.046482 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.046348    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-210.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:25:11.047021 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.047011    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:25:11.047052 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.047024    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:25:11.047052 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.047031    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:25:11.047604 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.047594    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:25:11.047981 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.047966    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:25:11.049014 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.048997    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:25:11.051770 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051758    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:25:11.051873 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051864    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:25:11.051903 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051892    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:25:11.051903 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051901    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:25:11.051952 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051915    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:25:11.051952 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051924    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:25:11.051952 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.051933    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:25:11.052241 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.052230    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:25:11.052282 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.052247    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:25:11.054184 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.054166    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:25:11.056284 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.056271    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:25:11.056325 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.056301    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:25:11.057507 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057468    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:25:11.057507 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057490    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:25:11.057507 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057497    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:25:11.057507 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057502    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057510    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057516    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057534    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057539    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057546    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057551    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057563    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:25:11.057624 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.057568    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:25:11.058462 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.058449    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:25:11.058671 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.058648    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:25:11.063502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.063481    2579 server.go:1268] "Started kubelet"
Jul 06 19:25:11.063596 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.063543    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:25:11.063758 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.063624    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:25:11.063758 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.063695    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:25:11.064253 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.064230    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-210.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:25:11.064341 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.064301    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:25:11.064341 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.064312    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:25:11.064403 ip-10-0-140-210 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:25:11.065495 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.065394    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:25:11.065794 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.065779    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:25:11.068960 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.068257    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-210.ec2.internal.18bfc9d8f17a4467  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-210.ec2.internal,UID:ip-10-0-140-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-210.ec2.internal,},FirstTimestamp:2026-07-06 19:25:11.063446631 +0000 UTC m=+0.381615789,LastTimestamp:2026-07-06 19:25:11.063446631 +0000 UTC m=+0.381615789,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-210.ec2.internal,}"
Jul 06 19:25:11.071702 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.071687    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:25:11.071778 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.071699    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:25:11.071844 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.071781    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.072259 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.072200    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:25:11.072366 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072348    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:25:11.072366 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072365    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:25:11.072483 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072377    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:25:11.072483 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072438    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:25:11.072483 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072447    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:25:11.072649 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072616    2579 factory.go:55] Registering systemd factory
Jul 06 19:25:11.072649 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072627    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:25:11.072856 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072840    2579 factory.go:153] Registering CRI-O factory
Jul 06 19:25:11.072856 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072855    2579 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:25:11.073004 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072904    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:25:11.073004 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072941    2579 factory.go:103] Registering Raw factory
Jul 06 19:25:11.073004 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.072962    2579 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:25:11.073526 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.073503    2579 manager.go:349] Starting recovery of all containers
Jul 06 19:25:11.076947 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.076922    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f44dl"
Jul 06 19:25:11.082644 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.082618    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:25:11.082729 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.082685    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:25:11.084685 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.084664    2579 manager.go:354] Recovery completed
Jul 06 19:25:11.086400 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.086375    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f44dl"
Jul 06 19:25:11.090410 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.090398    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.092016 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092002    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.092069 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092028    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.092069 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092038    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.092526 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092512    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:25:11.092526 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092526    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:25:11.092627 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092541    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:25:11.092627 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.092575    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.093646 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.093631    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.093763 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.093752    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.093871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.093861    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.094451 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.094435    2579 policy_none.go:49] "None policy: Start"
Jul 06 19:25:11.094451 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.094454    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:25:11.094547 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.094467    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:25:11.094840 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.094765    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-210.ec2.internal.18bfc9d8f32e3557  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-210.ec2.internal,UID:ip-10-0-140-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-210.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-210.ec2.internal,},FirstTimestamp:2026-07-06 19:25:11.092016471 +0000 UTC m=+0.410185628,LastTimestamp:2026-07-06 19:25:11.092016471 +0000 UTC m=+0.410185628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-210.ec2.internal,}"
Jul 06 19:25:11.095595 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.095581    2579 policy_none.go:47] "Start"
Jul 06 19:25:11.124873 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.124695    2579 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:25:11.124970 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.124911    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:25:11.124970 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.124924    2579 server.go:87] "Starting device plugin registration server"
Jul 06 19:25:11.125196 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.125185    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:25:11.125231 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.125199    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:25:11.125322 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.125301    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:25:11.125407 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.125393    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:25:11.125407 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.125407    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:25:11.125987 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.125960    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:25:11.126065 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.126012    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.225640 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.225602    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.226757 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.226571    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.226757 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.226617    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.226757 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.226631    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.226757 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.226658    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.233230 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.233209    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.233326 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.233234    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-210.ec2.internal\": node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.243428 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.243400    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:25:11.244653 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.244627    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:25:11.244729 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.244669    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:25:11.244729 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.244690    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:25:11.244729 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.244720    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:25:11.246442 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.246425    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.246717 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.246703    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:11.344880 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.344792    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"]
Jul 06 19:25:11.344880 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.344881    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.346461 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.346447    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.346525 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.346478    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.346525 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.346495    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.346525 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.346518    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.347890 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.347878    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.348049 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348028    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.348201 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348059    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.348785 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348766    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.348851 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348799    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.348851 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348809    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.348851 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348767    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.348953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348868    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.348953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.348879    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.350214 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.350201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.350259 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.350230    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:25:11.350932 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.350917    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:25:11.351009 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.350941    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:25:11.351009 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.350955    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:25:11.374677 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.374656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed89e62fa134a7283bb5b835876b6d56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal\" (UID: \"ed89e62fa134a7283bb5b835876b6d56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.374759 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.374661    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-210.ec2.internal\" not found" node="ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.374759 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.374696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed89e62fa134a7283bb5b835876b6d56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal\" (UID: \"ed89e62fa134a7283bb5b835876b6d56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.374759 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.374725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/651cad9dd4ffeaa969a97ffb85ed2c95-config\") pod \"kube-apiserver-proxy-ip-10-0-140-210.ec2.internal\" (UID: \"651cad9dd4ffeaa969a97ffb85ed2c95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.378164 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.378151    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-210.ec2.internal\" not found" node="ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.446644 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.446617    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.475252 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.475234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed89e62fa134a7283bb5b835876b6d56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal\" (UID: \"ed89e62fa134a7283bb5b835876b6d56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.475337 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.475259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed89e62fa134a7283bb5b835876b6d56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal\" (UID: \"ed89e62fa134a7283bb5b835876b6d56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.475337 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.475277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/651cad9dd4ffeaa969a97ffb85ed2c95-config\") pod \"kube-apiserver-proxy-ip-10-0-140-210.ec2.internal\" (UID: \"651cad9dd4ffeaa969a97ffb85ed2c95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.475337 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.475318    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/651cad9dd4ffeaa969a97ffb85ed2c95-config\") pod \"kube-apiserver-proxy-ip-10-0-140-210.ec2.internal\" (UID: \"651cad9dd4ffeaa969a97ffb85ed2c95\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.475433 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.475338    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed89e62fa134a7283bb5b835876b6d56-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal\" (UID: \"ed89e62fa134a7283bb5b835876b6d56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.475433 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.475348    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed89e62fa134a7283bb5b835876b6d56-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal\" (UID: \"ed89e62fa134a7283bb5b835876b6d56\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.547686 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.547652    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.648378 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.648299    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.678777 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.678742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.681274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.681258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:11.749359 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.749330    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.849828 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.849793    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.950360 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:11.950294    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:11.961828 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:11.961811    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:12.014259 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.014234    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:25:12.014656 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.014361    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:25:12.014656 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.014404    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:25:12.050561 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:12.050528    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:12.076885 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.076865    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:12.088153 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.088117    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:20:11 +0000 UTC" deadline="2027-12-25 22:14:48.553966896 +0000 UTC"
Jul 06 19:25:12.088267 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.088156    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12890h49m36.465815543s"
Jul 06 19:25:12.151498 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:12.151464    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:12.179951 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:12.179918    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651cad9dd4ffeaa969a97ffb85ed2c95.slice/crio-ea1095b74832a4fc035ed9b50381a0bc2eb3d4565aec993ea09bc3baeed24a2d WatchSource:0}: Error finding container ea1095b74832a4fc035ed9b50381a0bc2eb3d4565aec993ea09bc3baeed24a2d: Status 404 returned error can't find the container with id ea1095b74832a4fc035ed9b50381a0bc2eb3d4565aec993ea09bc3baeed24a2d
Jul 06 19:25:12.181389 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:12.181345    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded89e62fa134a7283bb5b835876b6d56.slice/crio-5b967fe6f97992297a32bbd3033c19663e2fe0d19976f3a1380057b3e0cce256 WatchSource:0}: Error finding container 5b967fe6f97992297a32bbd3033c19663e2fe0d19976f3a1380057b3e0cce256: Status 404 returned error can't find the container with id 5b967fe6f97992297a32bbd3033c19663e2fe0d19976f3a1380057b3e0cce256
Jul 06 19:25:12.186293 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.186272    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:25:12.248150 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.248021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal" event={"ID":"ed89e62fa134a7283bb5b835876b6d56","Type":"ContainerStarted","Data":"5b967fe6f97992297a32bbd3033c19663e2fe0d19976f3a1380057b3e0cce256"}
Jul 06 19:25:12.248985 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.248957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal" event={"ID":"651cad9dd4ffeaa969a97ffb85ed2c95","Type":"ContainerStarted","Data":"ea1095b74832a4fc035ed9b50381a0bc2eb3d4565aec993ea09bc3baeed24a2d"}
Jul 06 19:25:12.252091 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:12.252075    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:12.352643 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:12.352612    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:12.453175 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:12.453131    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-210.ec2.internal\" not found"
Jul 06 19:25:12.539079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.538993    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:12.572895 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.572870    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:12.588777 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.588757    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:25:12.589623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.589610    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal"
Jul 06 19:25:12.601565 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:12.601550    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:25:13.053017 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.052988    2579 apiserver.go:52] "Watching apiserver"
Jul 06 19:25:13.060338 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.060313    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:25:13.060788 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.060761    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d","openshift-dns/node-resolver-8d85z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal","openshift-multus/multus-additional-cni-plugins-rz49b","openshift-multus/network-metrics-daemon-cqbmk","openshift-network-diagnostics/network-check-target-mt2pm","openshift-network-operator/iptables-alerter-rr6dq","openshift-ovn-kubernetes/ovnkube-node-shkfb","kube-system/global-pull-secret-syncer-nvlc7","kube-system/konnectivity-agent-gcxfv","kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xvzp6","openshift-image-registry/node-ca-hkqwx","openshift-multus/multus-gtk88"]
Jul 06 19:25:13.062722 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.062702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.063914 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.063889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.065081 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.065061    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8qqm\""
Jul 06 19:25:13.065208 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.065192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.065973 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.065951    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.066059 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.065997    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:25:13.066192 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.066085    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.066715 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.066614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xg6kd\""
Jul 06 19:25:13.066872 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.066855    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.066939 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.066879    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:25:13.066939 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.066858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.067207 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.067172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.067414 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.067394    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:25:13.067593 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.067467    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.067789 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.067772    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.067921 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.067801    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9ssp8\""
Jul 06 19:25:13.067921 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.067811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:25:13.068119 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.068090    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.068280 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.068259    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:13.069396 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.069376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:13.069497 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.069441    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:13.069817 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.069797    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:25:13.070374 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.070098    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:25:13.070374 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.070192    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7rfxj\""
Jul 06 19:25:13.070753 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.070737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.070843 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.070798    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:13.072289 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.072259    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:25:13.072289 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.072278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.073723 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.073706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.075231 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.074654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.075231 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.074822    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lwhnc\""
Jul 06 19:25:13.075231 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.074932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:25:13.075231 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.074996    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.076503 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.075769    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.076503 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.075787    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89757\""
Jul 06 19:25:13.076503 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.076279    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.076743 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.076719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.079012 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.078962    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:25:13.079149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.079125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:25:13.079447 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.079277    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fc8qn\""
Jul 06 19:25:13.080388 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.080363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.081948 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.081931    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.082866 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.082658    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.082866 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.082749    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:25:13.082866 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.082658    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:25:13.083290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.083256    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:25:13.083595 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.083578    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:25:13.083595 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.083593    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gjwv8\""
Jul 06 19:25:13.083751 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.083584    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.084952 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.084930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-socket-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.085067 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.084964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-host\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.085067 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.084985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-serviceca\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.085067 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085008    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:13.085067 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085032    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.085067 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-system-cni-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-cni-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-cni-bin\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-hostroot\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbht\" (UniqueName: \"kubernetes.io/projected/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-kube-api-access-vfbht\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-hosts-file\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfff5\" (UniqueName: \"kubernetes.io/projected/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-kube-api-access-hfff5\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-conf-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-daemon-config\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvsg8\" (UniqueName: \"kubernetes.io/projected/f1dc48af-b6ab-4544-a06f-a83922b10830-kube-api-access-wvsg8\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb6f33c4-4064-483e-93b7-cc9a57a032c1-iptables-alerter-script\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.085471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-multus-certs\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71f9c61-120c-4405-9649-feccff6b0788-dbus\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-os-release\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-socket-dir-parent\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-k8s-cni-cncf-io\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085641    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x7g9w\""
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7gpx\" (UniqueName: \"kubernetes.io/projected/bbc5cad4-ec17-484f-a8d8-37f502f04480-kube-api-access-z7gpx\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-registration-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085755    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-device-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085804    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sftvn\" (UniqueName: \"kubernetes.io/projected/eb6f33c4-4064-483e-93b7-cc9a57a032c1-kube-api-access-sftvn\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cnibin\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-os-release\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-etc-selinux\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.086228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-sys-fs\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.085977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-tmp-dir\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71f9c61-120c-4405-9649-feccff6b0788-kubelet-config\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1dc48af-b6ab-4544-a06f-a83922b10830-cni-binary-copy\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-netns\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-cni-multus\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-kubelet\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-etc-kubernetes\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l66fb\" (UniqueName: \"kubernetes.io/projected/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-kube-api-access-l66fb\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnjj8\" (UniqueName: \"kubernetes.io/projected/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-kube-api-access-mnjj8\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb6f33c4-4064-483e-93b7-cc9a57a032c1-host-slash\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-system-cni-dir\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-cnibin\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.087149 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.086394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cni-binary-copy\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.120097 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.120073    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4wb9d"
Jul 06 19:25:13.130717 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.130694    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4wb9d"
Jul 06 19:25:13.173275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.173247    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:25:13.187072 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-cnibin\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.187249 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cni-binary-copy\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.187249 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187189    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-cnibin\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.187249 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-socket-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.187249 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-host\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-serviceca\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8-agent-certs\") pod \"konnectivity-agent-gcxfv\" (UID: \"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8\") " pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-run-netns\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-lib-modules\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.187456 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvsg8\" (UniqueName: \"kubernetes.io/projected/f1dc48af-b6ab-4544-a06f-a83922b10830-kube-api-access-wvsg8\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb6f33c4-4064-483e-93b7-cc9a57a032c1-iptables-alerter-script\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-multus-certs\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71f9c61-120c-4405-9649-feccff6b0788-dbus\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-var-lib-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-node-log\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-ovnkube-config\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187595    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-tuned\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfftl\" (UniqueName: \"kubernetes.io/projected/68d6f743-ebd8-4952-ac9e-b232ce2315d7-kube-api-access-hfftl\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-slash\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-socket-dir-parent\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-k8s-cni-cncf-io\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7gpx\" (UniqueName: \"kubernetes.io/projected/bbc5cad4-ec17-484f-a8d8-37f502f04480-kube-api-access-z7gpx\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-device-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-tmp-dir\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-os-release\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.187871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71f9c61-120c-4405-9649-feccff6b0788-kubelet-config\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysconfig\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-kubernetes\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-var-lib-kubelet\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187910    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-host\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d6f743-ebd8-4952-ac9e-b232ce2315d7-tmp\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-netns\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187960    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a71f9c61-120c-4405-9649-feccff6b0788-dbus\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-cni-multus\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-kubelet\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnjj8\" (UniqueName: \"kubernetes.io/projected/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-kube-api-access-mnjj8\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-systemd-units\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188068    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-socket-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.187746    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cni-binary-copy\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-ovn\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysctl-d\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.188680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-host\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188277    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-multus-certs\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb6f33c4-4064-483e-93b7-cc9a57a032c1-host-slash\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-system-cni-dir\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188347    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-os-release\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188398    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-socket-dir-parent\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-log-socket\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-modprobe-d\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-run\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-system-cni-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-cni-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-cni-bin\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188574    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-serviceca\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-hostroot\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbht\" (UniqueName: \"kubernetes.io/projected/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-kube-api-access-vfbht\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.189556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-hosts-file\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfff5\" (UniqueName: \"kubernetes.io/projected/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-kube-api-access-hfff5\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8-konnectivity-ca\") pod \"konnectivity-agent-gcxfv\" (UID: \"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8\") " pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-conf-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-daemon-config\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188802    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eb6f33c4-4064-483e-93b7-cc9a57a032c1-iptables-alerter-script\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-tmp-dir\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-ovnkube-script-lib\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188863    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188873    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-cni-bin\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188927    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-netns\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188926    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-run-k8s-cni-cncf-io\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188935    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-hosts-file\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.188946    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-system-cni-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189008    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-cni-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.189017    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:13.190344 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189098    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189158    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-conf-dir\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-systemd\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-kubelet\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysctl-conf\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-os-release\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-registration-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189418    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-kubelet\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-etc-selinux\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189476    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-system-cni-dir\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.189543    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:13.689519804 +0000 UTC m=+3.007688976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189577    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-device-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.189647    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189668    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1dc48af-b6ab-4544-a06f-a83922b10830-multus-daemon-config\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189679    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-host-var-lib-cni-multus\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.189700    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:13.689683938 +0000 UTC m=+3.007853092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:13.191181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-sys-fs\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189749    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189754    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-hostroot\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189794    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-etc-selinux\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-cni-bin\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189814    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-sys-fs\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189850    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb6f33c4-4064-483e-93b7-cc9a57a032c1-host-slash\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-os-release\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sftvn\" (UniqueName: \"kubernetes.io/projected/eb6f33c4-4064-483e-93b7-cc9a57a032c1-kube-api-access-sftvn\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189869    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-registration-dir\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189898    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a71f9c61-120c-4405-9649-feccff6b0788-kubelet-config\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.189910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cnibin\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-etc-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190029    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-cnibin\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1dc48af-b6ab-4544-a06f-a83922b10830-cni-binary-copy\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-etc-kubernetes\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.191933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190142    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l66fb\" (UniqueName: \"kubernetes.io/projected/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-kube-api-access-l66fb\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190230    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1dc48af-b6ab-4544-a06f-a83922b10830-etc-kubernetes\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-cni-netd\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a712b72-b758-416f-a314-2d6e12208e0d-ovn-node-metrics-cert\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-sys\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-systemd\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-env-overrides\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp9zj\" (UniqueName: \"kubernetes.io/projected/6a712b72-b758-416f-a314-2d6e12208e0d-kube-api-access-lp9zj\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.192589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.190560    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1dc48af-b6ab-4544-a06f-a83922b10830-cni-binary-copy\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.196438 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.196410    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:25:13.197365 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.197330    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:13.197365 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.197352    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:13.197365 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.197365    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:13.197573 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.197427    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:25:13.697411321 +0000 UTC m=+3.015580479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:13.201729 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.201674    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7gpx\" (UniqueName: \"kubernetes.io/projected/bbc5cad4-ec17-484f-a8d8-37f502f04480-kube-api-access-z7gpx\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.201967 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.201841    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnjj8\" (UniqueName: \"kubernetes.io/projected/0c20cd12-3105-4c82-bc50-58ae5c0efdd5-kube-api-access-mnjj8\") pod \"node-resolver-8d85z\" (UID: \"0c20cd12-3105-4c82-bc50-58ae5c0efdd5\") " pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.204532 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.204508    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbht\" (UniqueName: \"kubernetes.io/projected/6f9a1f0d-8d53-4fde-9efc-79242f7bd206-kube-api-access-vfbht\") pod \"aws-ebs-csi-driver-node-z478d\" (UID: \"6f9a1f0d-8d53-4fde-9efc-79242f7bd206\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.205895 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.205834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvsg8\" (UniqueName: \"kubernetes.io/projected/f1dc48af-b6ab-4544-a06f-a83922b10830-kube-api-access-wvsg8\") pod \"multus-gtk88\" (UID: \"f1dc48af-b6ab-4544-a06f-a83922b10830\") " pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.205895 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.205883    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l66fb\" (UniqueName: \"kubernetes.io/projected/7c7ca5a5-a639-40fa-a950-cfbb060c9ad4-kube-api-access-l66fb\") pod \"multus-additional-cni-plugins-rz49b\" (UID: \"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4\") " pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.206905 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.206881    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sftvn\" (UniqueName: \"kubernetes.io/projected/eb6f33c4-4064-483e-93b7-cc9a57a032c1-kube-api-access-sftvn\") pod \"iptables-alerter-rr6dq\" (UID: \"eb6f33c4-4064-483e-93b7-cc9a57a032c1\") " pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.207492 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.207470    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfff5\" (UniqueName: \"kubernetes.io/projected/86827bda-61c7-4fa9-a6d9-b04bb61c59e4-kube-api-access-hfff5\") pod \"node-ca-hkqwx\" (UID: \"86827bda-61c7-4fa9-a6d9-b04bb61c59e4\") " pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.291532 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8-konnectivity-ca\") pod \"konnectivity-agent-gcxfv\" (UID: \"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8\") " pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.291706 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-ovnkube-script-lib\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-systemd\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-kubelet\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysctl-conf\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-systemd\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-cni-bin\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291979    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-cni-bin\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.291987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-etc-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-cni-netd\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292031    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-kubelet\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a712b72-b758-416f-a314-2d6e12208e0d-ovn-node-metrics-cert\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-sys\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-systemd\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-env-overrides\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp9zj\" (UniqueName: \"kubernetes.io/projected/6a712b72-b758-416f-a314-2d6e12208e0d-kube-api-access-lp9zj\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292183    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysctl-conf\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292194    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8-konnectivity-ca\") pod \"konnectivity-agent-gcxfv\" (UID: \"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8\") " pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.292650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8-agent-certs\") pod \"konnectivity-agent-gcxfv\" (UID: \"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8\") " pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292229    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292244    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-etc-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-run-netns\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292289    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-sys\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292329    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-systemd\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-lib-modules\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-var-lib-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-node-log\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292405    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-run-netns\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292405    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-ovnkube-script-lib\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-ovnkube-config\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-tuned\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292488    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-var-lib-openvswitch\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292371    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-cni-netd\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.293658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292525    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-run-ovn-kubernetes\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292529    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-lib-modules\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-node-log\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292577    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-env-overrides\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfftl\" (UniqueName: \"kubernetes.io/projected/68d6f743-ebd8-4952-ac9e-b232ce2315d7-kube-api-access-hfftl\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-slash\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysconfig\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-kubernetes\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-var-lib-kubelet\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292747    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-var-lib-kubelet\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292743    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-slash\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-host\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292798    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d6f743-ebd8-4952-ac9e-b232ce2315d7-tmp\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292804    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysconfig\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-systemd-units\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-ovn\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292869    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-kubernetes\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysctl-d\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.294502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-log-socket\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-modprobe-d\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.292977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-run\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293004    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a712b72-b758-416f-a314-2d6e12208e0d-ovnkube-config\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-systemd-units\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293074    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-run\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293096    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-run-ovn\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-log-socket\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293220    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-modprobe-d\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293254    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-sysctl-d\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293301    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68d6f743-ebd8-4952-ac9e-b232ce2315d7-host\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.293325    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a712b72-b758-416f-a314-2d6e12208e0d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.295399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.295243    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d6f743-ebd8-4952-ac9e-b232ce2315d7-tmp\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.295946 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.295416    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8-agent-certs\") pod \"konnectivity-agent-gcxfv\" (UID: \"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8\") " pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.295946 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.295533    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a712b72-b758-416f-a314-2d6e12208e0d-ovn-node-metrics-cert\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.296015 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.295951    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68d6f743-ebd8-4952-ac9e-b232ce2315d7-etc-tuned\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.307309 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.307252    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp9zj\" (UniqueName: \"kubernetes.io/projected/6a712b72-b758-416f-a314-2d6e12208e0d-kube-api-access-lp9zj\") pod \"ovnkube-node-shkfb\" (UID: \"6a712b72-b758-416f-a314-2d6e12208e0d\") " pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.307309 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.307302    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfftl\" (UniqueName: \"kubernetes.io/projected/68d6f743-ebd8-4952-ac9e-b232ce2315d7-kube-api-access-hfftl\") pod \"tuned-xvzp6\" (UID: \"68d6f743-ebd8-4952-ac9e-b232ce2315d7\") " pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.378216 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.378183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rr6dq"
Jul 06 19:25:13.391287 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.391252    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hkqwx"
Jul 06 19:25:13.399243 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.399220    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gtk88"
Jul 06 19:25:13.403833 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.403811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rz49b"
Jul 06 19:25:13.411442 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.411420    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d"
Jul 06 19:25:13.418139 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.418119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8d85z"
Jul 06 19:25:13.424709 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.424689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:13.431228 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.431209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:13.433169 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.433150    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:13.436093 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.436076    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xvzp6"
Jul 06 19:25:13.695997 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.695918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:13.695997 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.695961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:13.696229 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.696078    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:13.696229 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.696125    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:13.696229 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.696154    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.696139763 +0000 UTC m=+4.014308911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:13.696229 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.696182    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.696165625 +0000 UTC m=+4.014334785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:13.796696 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:13.796666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:13.796885 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.796861    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:13.796927 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.796894    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:13.796927 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.796910    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:13.796996 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:13.796976    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:25:14.796955366 +0000 UTC m=+4.115124533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:14.133244 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.133158    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:13 +0000 UTC" deadline="2027-12-22 00:08:12.585552428 +0000 UTC"
Jul 06 19:25:14.133244 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.133206    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12796h42m58.452349961s"
Jul 06 19:25:14.148124 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:14.148077    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d6f743_ebd8_4952_ac9e_b232ce2315d7.slice/crio-8477cd44cdb3b7ec2db6802d3f516596a9caa65f35a6aa9e5839b19e79c02ffa WatchSource:0}: Error finding container 8477cd44cdb3b7ec2db6802d3f516596a9caa65f35a6aa9e5839b19e79c02ffa: Status 404 returned error can't find the container with id 8477cd44cdb3b7ec2db6802d3f516596a9caa65f35a6aa9e5839b19e79c02ffa
Jul 06 19:25:14.153464 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:14.153436    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dc48af_b6ab_4544_a06f_a83922b10830.slice/crio-800464e94bdf8cdaae67766580917a5700fb61c92f09f753423e1fa3a923058a WatchSource:0}: Error finding container 800464e94bdf8cdaae67766580917a5700fb61c92f09f753423e1fa3a923058a: Status 404 returned error can't find the container with id 800464e94bdf8cdaae67766580917a5700fb61c92f09f753423e1fa3a923058a
Jul 06 19:25:14.158603 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:14.158548    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a712b72_b758_416f_a314_2d6e12208e0d.slice/crio-9fc36982ed4970195e0c7b8286361b9769827573dfbf4336fabc9e14d5350ac9 WatchSource:0}: Error finding container 9fc36982ed4970195e0c7b8286361b9769827573dfbf4336fabc9e14d5350ac9: Status 404 returned error can't find the container with id 9fc36982ed4970195e0c7b8286361b9769827573dfbf4336fabc9e14d5350ac9
Jul 06 19:25:14.166720 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:25:14.166212    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7ca5a5_a639_40fa_a950_cfbb060c9ad4.slice/crio-a359c67e3b293223a349f64e5168279270c861eb35b26b0ca5e65e49e24f838b WatchSource:0}: Error finding container a359c67e3b293223a349f64e5168279270c861eb35b26b0ca5e65e49e24f838b: Status 404 returned error can't find the container with id a359c67e3b293223a349f64e5168279270c861eb35b26b0ca5e65e49e24f838b
Jul 06 19:25:14.253397 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.253249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rr6dq" event={"ID":"eb6f33c4-4064-483e-93b7-cc9a57a032c1","Type":"ContainerStarted","Data":"5d3eea3335bfe235cdc4383ea6d481dca7bb88267e59116b5402fbcd58ccc13f"}
Jul 06 19:25:14.254224 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.254203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gtk88" event={"ID":"f1dc48af-b6ab-4544-a06f-a83922b10830","Type":"ContainerStarted","Data":"800464e94bdf8cdaae67766580917a5700fb61c92f09f753423e1fa3a923058a"}
Jul 06 19:25:14.256183 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.256158    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal" event={"ID":"651cad9dd4ffeaa969a97ffb85ed2c95","Type":"ContainerStarted","Data":"8dfef389ac74399b8d39ac23b71c804520e8c7799f98855632abed1e4a0513b6"}
Jul 06 19:25:14.257150 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.257130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8d85z" event={"ID":"0c20cd12-3105-4c82-bc50-58ae5c0efdd5","Type":"ContainerStarted","Data":"c949217ee235783a28538f0ca19a82089ec73189761ca063e00b64e49c77e8e3"}
Jul 06 19:25:14.258287 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.258266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"9fc36982ed4970195e0c7b8286361b9769827573dfbf4336fabc9e14d5350ac9"}
Jul 06 19:25:14.259416 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.259393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xvzp6" event={"ID":"68d6f743-ebd8-4952-ac9e-b232ce2315d7","Type":"ContainerStarted","Data":"8477cd44cdb3b7ec2db6802d3f516596a9caa65f35a6aa9e5839b19e79c02ffa"}
Jul 06 19:25:14.260468 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.260446    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerStarted","Data":"a359c67e3b293223a349f64e5168279270c861eb35b26b0ca5e65e49e24f838b"}
Jul 06 19:25:14.261969 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.261948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gcxfv" event={"ID":"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8","Type":"ContainerStarted","Data":"220b9cc05763bba4fa8b3020d19dca84219a8615f49be9b00f281a37ed7d9b33"}
Jul 06 19:25:14.262928 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.262910    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d" event={"ID":"6f9a1f0d-8d53-4fde-9efc-79242f7bd206","Type":"ContainerStarted","Data":"da14d9e89e3f6f352e2c31fe2b09f80ad851cbfce02f1d4eb94d3245c5fe065a"}
Jul 06 19:25:14.264947 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.264927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hkqwx" event={"ID":"86827bda-61c7-4fa9-a6d9-b04bb61c59e4","Type":"ContainerStarted","Data":"8ce529a6bcbe03916c236d84b18bc5aa1efda426a4f25bf31a3a8e7522481251"}
Jul 06 19:25:14.282707 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.282669    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-210.ec2.internal" podStartSLOduration=2.282657334 podStartE2EDuration="2.282657334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:14.282156769 +0000 UTC m=+3.600325955" watchObservedRunningTime="2026-07-06 19:25:14.282657334 +0000 UTC m=+3.600826500"
Jul 06 19:25:14.705797 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.705055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:14.705797 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.705097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:14.705797 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.705250    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:14.705797 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.705311    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:16.705292674 +0000 UTC m=+6.023461832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:14.705797 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.705674    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:14.705797 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.705717    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:16.705704385 +0000 UTC m=+6.023873544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:14.807148 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.806538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:14.807148 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.806692    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:14.807148 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.806712    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:14.807148 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.806724    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:14.807148 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:14.806776    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:25:16.80675886 +0000 UTC m=+6.124928007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:14.822179 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:14.821969    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:25:15.133664 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.133607    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:13 +0000 UTC" deadline="2028-01-06 03:29:05.79546017 +0000 UTC"
Jul 06 19:25:15.133664 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.133665    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13160h3m50.661799235s"
Jul 06 19:25:15.248280 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.248250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:15.248457 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:15.248397    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:15.248840 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.248819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:15.248933 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:15.248919    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:15.248986 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.248980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:15.249069 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:15.249050    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:15.301142 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.298663    2579 generic.go:356] "Generic (PLEG): container finished" podID="ed89e62fa134a7283bb5b835876b6d56" containerID="c47a87f7c8544675743c52028d4a0295256247b46391ad4b0c2de992ad477805" exitCode=0
Jul 06 19:25:15.301142 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:15.298774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal" event={"ID":"ed89e62fa134a7283bb5b835876b6d56","Type":"ContainerDied","Data":"c47a87f7c8544675743c52028d4a0295256247b46391ad4b0c2de992ad477805"}
Jul 06 19:25:16.314151 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:16.313880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal" event={"ID":"ed89e62fa134a7283bb5b835876b6d56","Type":"ContainerStarted","Data":"aa63488fc472af2adfa031b4aa032a7bd0bc4a3e99c3b7935a2ec9eb08510274"}
Jul 06 19:25:16.332518 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:16.331888    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-210.ec2.internal" podStartSLOduration=4.331866521 podStartE2EDuration="4.331866521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:16.331485405 +0000 UTC m=+5.649654599" watchObservedRunningTime="2026-07-06 19:25:16.331866521 +0000 UTC m=+5.650035688"
Jul 06 19:25:16.731341 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:16.731256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:16.731494 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:16.731361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:16.731494 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.731477    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:16.731609 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.731539    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:20.731519199 +0000 UTC m=+10.049688362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:16.732008 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.731918    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:16.732008 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.731969    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:20.73195475 +0000 UTC m=+10.050123896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:16.832236 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:16.832200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:16.832420 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.832388    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:16.832420 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.832409    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:16.832520 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.832421    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:16.832520 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:16.832477    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:25:20.832460158 +0000 UTC m=+10.150629316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:17.245680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:17.245634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:17.245680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:17.245681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:17.245909 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:17.245639    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:17.245909 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:17.245780    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:17.245909 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:17.245832    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:17.245909 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:17.245894    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:19.248780 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:19.248696    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:19.248780 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:19.248738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:19.248780 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:19.248707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:19.249362 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:19.248835    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:19.249362 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:19.248915    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:19.249362 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:19.248994    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:20.768198 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:20.767418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:20.768198 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:20.767468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:20.768198 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.767614    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:20.768198 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.767679    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:28.767660057 +0000 UTC m=+18.085829224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:20.768198 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.768088    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:20.768198 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.768156    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:28.768140816 +0000 UTC m=+18.086309965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:20.868370 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:20.868337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:20.868570 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.868499    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:20.868570 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.868521    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:20.868570 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.868531    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:20.868723 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:20.868583    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:25:28.868566166 +0000 UTC m=+18.186735326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:21.246348 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:21.246268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:21.246539 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:21.246369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:21.246539 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:21.246398    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:21.246539 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:21.246458    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:21.246539 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:21.246503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:21.246754 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:21.246577    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:23.248381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:23.248346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:23.248381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:23.248371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:23.248839 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:23.248371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:23.248839 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:23.248467    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:23.248839 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:23.248565    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:23.248839 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:23.248645    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:25.245910 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:25.245623    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:25.245910 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:25.245625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:25.245910 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:25.245772    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:25.245910 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:25.245625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:25.245910 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:25.245846    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:25.245910 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:25.245913    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:27.244961 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:27.244923    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:27.245431 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:27.244970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:27.245431 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:27.244924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:27.245431 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:27.245061    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:27.245431 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:27.245170    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:27.245431 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:27.245294    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:28.825381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:28.825340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:28.825881 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:28.825391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:28.825881 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.825503    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:28.825881 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.825523    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:28.825881 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.825575    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:44.825556331 +0000 UTC m=+34.143725492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:28.825881 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.825597    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:44.825585732 +0000 UTC m=+34.143754877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:28.926238 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:28.926202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:28.926426 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.926393    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:28.926426 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.926417    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:28.926596 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.926430    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:28.926596 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:28.926499    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:25:44.926479194 +0000 UTC m=+34.244648341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:29.245652 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:29.245619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:29.245841 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:29.245622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:29.245841 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:29.245750    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:29.245841 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:29.245634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:29.245841 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:29.245823    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:29.246036 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:29.245915    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:31.246627 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:31.246591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:31.247122 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:31.246720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:31.247122 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:31.246727    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:31.247122 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:31.246841    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:31.247122 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:31.246894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:31.247122 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:31.246946    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:33.245450 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.245160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:33.246006 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.245164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:33.246006 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:33.245545    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:33.246006 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.245189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:33.246006 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:33.245599    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:33.246006 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:33.245689    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:33.349577 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.349542    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ca5a5-a639-40fa-a950-cfbb060c9ad4" containerID="8391ec39034f87c3e99d9ae0d5386606b74957b6b5084dae8dab1677db4c01cd" exitCode=0
Jul 06 19:25:33.349747 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.349590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerDied","Data":"8391ec39034f87c3e99d9ae0d5386606b74957b6b5084dae8dab1677db4c01cd"}
Jul 06 19:25:33.351443 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.351426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gcxfv" event={"ID":"0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8","Type":"ContainerStarted","Data":"5cfb84b7363e9b93a49168c5f8dddcc86fd28880eb3903b1c881fd5eab39c19c"}
Jul 06 19:25:33.353334 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.353311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d" event={"ID":"6f9a1f0d-8d53-4fde-9efc-79242f7bd206","Type":"ContainerStarted","Data":"8b08d3c3145b3f3d33d8c94ccd7654bcb7359833f2bdda4ad417082312cba4f1"}
Jul 06 19:25:33.355071 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.355046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hkqwx" event={"ID":"86827bda-61c7-4fa9-a6d9-b04bb61c59e4","Type":"ContainerStarted","Data":"7dc94b28e29f471d12eeed873e38761086bacf23345619912d3d6b0d75ec4d29"}
Jul 06 19:25:33.356779 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.356727    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gtk88" event={"ID":"f1dc48af-b6ab-4544-a06f-a83922b10830","Type":"ContainerStarted","Data":"398b5136c00acc295295474c5d88d37e1bbde35bff24ed07ee9b75f3ac021d15"}
Jul 06 19:25:33.358855 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.358830    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8d85z" event={"ID":"0c20cd12-3105-4c82-bc50-58ae5c0efdd5","Type":"ContainerStarted","Data":"eb83e637b1f2107eb82d23cfd1f4a9d632ecdf21245c18b391efe53658f3dd90"}
Jul 06 19:25:33.362312 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.362293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"0dcc6c4a73ba53f42a50efea7983941ec1933362030917d12c75bbedc14a125c"}
Jul 06 19:25:33.362585 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.362357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"5ab911ae92e7321ef680614333e3a20b32aadd59f29db819f3aea96852ef710c"}
Jul 06 19:25:33.362585 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.362406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"153bc2bcde5a6ec0b48ca9118ac249b8a32f4003771027f9acecc57ada12758c"}
Jul 06 19:25:33.362585 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.362439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"9b44774f1abcbb41b5396e4f5cf07cee467e94e4867d47c748135696235e3f75"}
Jul 06 19:25:33.362585 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.362468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"78b61c587fbe8b8ee32029d54dc4d1b4b295f9fb14cd2fa814ee535098dd6e81"}
Jul 06 19:25:33.362585 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.362501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"ce7c91b720a0bf1de3f7d61fed635f1792efe59512d912b284094d7b2e47a6e5"}
Jul 06 19:25:33.363908 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.363886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xvzp6" event={"ID":"68d6f743-ebd8-4952-ac9e-b232ce2315d7","Type":"ContainerStarted","Data":"eeec294d1b4b735c0195a62d805f40e82299b6ebebc32926b0c5aa119fc1935f"}
Jul 06 19:25:33.390832 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.390769    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8d85z" podStartSLOduration=4.063122708 podStartE2EDuration="22.390747443s" totalImagesPullingTime="18.327624735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:33.390459329 +0000 UTC m=+22.708628490" watchObservedRunningTime="2026-07-06 19:25:33.390747443 +0000 UTC m=+22.708916651"
Jul 06 19:25:33.414580 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.414527    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gcxfv" podStartSLOduration=8.25133755 podStartE2EDuration="22.414511044s" totalImagesPullingTime="14.163173494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:33.414059068 +0000 UTC m=+22.732228235" watchObservedRunningTime="2026-07-06 19:25:33.414511044 +0000 UTC m=+22.732680209"
Jul 06 19:25:33.440248 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.440207    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xvzp6" podStartSLOduration=4.098487076 podStartE2EDuration="22.440191844s" totalImagesPullingTime="18.341704768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:33.439908988 +0000 UTC m=+22.758078178" watchObservedRunningTime="2026-07-06 19:25:33.440191844 +0000 UTC m=+22.758361010"
Jul 06 19:25:33.457123 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.457068    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hkqwx" podStartSLOduration=4.131213862 podStartE2EDuration="22.457053171s" totalImagesPullingTime="18.325839309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:33.456905941 +0000 UTC m=+22.775075109" watchObservedRunningTime="2026-07-06 19:25:33.457053171 +0000 UTC m=+22.775222335"
Jul 06 19:25:33.475881 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:33.475830    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gtk88" podStartSLOduration=4.077536659 podStartE2EDuration="22.475802309s" totalImagesPullingTime="18.39826565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:33.475209329 +0000 UTC m=+22.793378516" watchObservedRunningTime="2026-07-06 19:25:33.475802309 +0000 UTC m=+22.793971506"
Jul 06 19:25:34.125373 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.125343    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:25:34.139851 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.139762    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:25:34.12536924Z","UUID":"f5d3c941-a8a3-41ef-8753-b351462526a6","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:25:34.141332 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.141312    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:25:34.141412 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.141357    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:25:34.367706 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.367626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d" event={"ID":"6f9a1f0d-8d53-4fde-9efc-79242f7bd206","Type":"ContainerStarted","Data":"cccc89c2492a7cd1f5e9cf09c80940370aa6c89c412ec6db9565c84f16f56458"}
Jul 06 19:25:34.368965 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.368937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rr6dq" event={"ID":"eb6f33c4-4064-483e-93b7-cc9a57a032c1","Type":"ContainerStarted","Data":"ed0a31c192d27a8a64c8e5fa70f2afc62b768a82345d24f0ec7e8182e8eefab6"}
Jul 06 19:25:34.385380 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.385337    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rr6dq" podStartSLOduration=5.056207204 podStartE2EDuration="23.385325083s" totalImagesPullingTime="18.329117879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:34.384919629 +0000 UTC m=+23.703088797" watchObservedRunningTime="2026-07-06 19:25:34.385325083 +0000 UTC m=+23.703494248"
Jul 06 19:25:34.970472 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.970437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:34.971343 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:34.971279    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:35.245294 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:35.245222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:35.245294 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:35.245258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:35.245599 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:35.245222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:35.245599 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:35.245326    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:35.245599 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:35.245414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:35.245599 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:35.245490    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:36.378411 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:36.378125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d" event={"ID":"6f9a1f0d-8d53-4fde-9efc-79242f7bd206","Type":"ContainerStarted","Data":"e23ddc502ff6462271c7d4f072c71d0b3a8638d9d8c53cf7f723efa1635add3d"}
Jul 06 19:25:36.381993 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:36.381788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"657d0bb9842c359621d6065849fb97266d39d66925f3143c33085d7ce1ea54fc"}
Jul 06 19:25:36.382297 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:36.382150    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:25:36.400682 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:36.400622    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z478d" podStartSLOduration=4.338249057 podStartE2EDuration="25.400605518s" totalImagesPullingTime="21.062356461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:36.400515711 +0000 UTC m=+25.718684878" watchObservedRunningTime="2026-07-06 19:25:36.400605518 +0000 UTC m=+25.718774685"
Jul 06 19:25:37.245175 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:37.245144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:37.245359 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:37.245145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:37.245359 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:37.245245    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:37.245359 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:37.245149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:37.245359 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:37.245329    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:37.245517 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:37.245421    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:37.495737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:37.495677    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8d85z_0c20cd12-3105-4c82-bc50-58ae5c0efdd5/dns-node-resolver/0.log"
Jul 06 19:25:38.391024 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:38.390820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" event={"ID":"6a712b72-b758-416f-a314-2d6e12208e0d","Type":"ContainerStarted","Data":"dc159cce59c28318103c40d28ac2c55fc365c5a172c105caf68e4178e53f94cb"}
Jul 06 19:25:38.391201 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:38.391131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:38.391274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:38.391203    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:38.407903 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:38.407882    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:38.426386 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:38.426341    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb" podStartSLOduration=9.029484464 podStartE2EDuration="27.426326039s" totalImagesPullingTime="18.396841575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:38.42582934 +0000 UTC m=+27.743998525" watchObservedRunningTime="2026-07-06 19:25:38.426326039 +0000 UTC m=+27.744495204"
Jul 06 19:25:38.672269 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:38.672199    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hkqwx_86827bda-61c7-4fa9-a6d9-b04bb61c59e4/node-ca/0.log"
Jul 06 19:25:39.245647 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.245612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:39.245801 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.245677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:39.245801 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.245673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:39.245801 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:39.245783    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:39.245955 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:39.245868    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:39.246008 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:39.245989    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:39.394207 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.394070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:39.411900 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.411868    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:25:39.990508 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.990472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mt2pm"]
Jul 06 19:25:39.990874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.990634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:39.990874 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:39.990758    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:39.995289 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.995037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cqbmk"]
Jul 06 19:25:39.995289 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.995179    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:39.995289 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:39.995284    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:39.995749 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.995728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nvlc7"]
Jul 06 19:25:39.995841 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:39.995825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:39.995942 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:39.995923    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:40.397981 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:40.397945    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ca5a5-a639-40fa-a950-cfbb060c9ad4" containerID="33d9b312c182bca6118f187bab4da2ec38270155293297dd52f744af7126513b" exitCode=0
Jul 06 19:25:40.398158 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:40.398033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerDied","Data":"33d9b312c182bca6118f187bab4da2ec38270155293297dd52f744af7126513b"}
Jul 06 19:25:40.539047 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:40.539015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:40.539249 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:40.539150    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:25:40.539752 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:40.539725    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gcxfv"
Jul 06 19:25:41.248516 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:41.248385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:41.248999 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:41.248597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:41.248999 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:41.248536    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:41.248999 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:41.248765    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:42.245449 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:42.245280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:42.245630 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:42.245543    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:42.404893 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:42.404859    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ca5a5-a639-40fa-a950-cfbb060c9ad4" containerID="ad70f509e2f03ae576e550eaedfd4a65bb30cadce208f1580cf22418bd165ee1" exitCode=0
Jul 06 19:25:42.405500 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:42.404920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerDied","Data":"ad70f509e2f03ae576e550eaedfd4a65bb30cadce208f1580cf22418bd165ee1"}
Jul 06 19:25:43.245714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:43.245679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:43.245887 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:43.245792    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:43.245887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:43.245870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:43.245985 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:43.245966    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:43.409576 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:43.409545    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ca5a5-a639-40fa-a950-cfbb060c9ad4" containerID="d2150ecd3675d68d606562608ca7531ec48d64f82befd6ea03622c67b38cff3e" exitCode=0
Jul 06 19:25:43.409933 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:43.409580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerDied","Data":"d2150ecd3675d68d606562608ca7531ec48d64f82befd6ea03622c67b38cff3e"}
Jul 06 19:25:44.245527 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:44.245490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:44.245692 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.245589    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:44.844057 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:44.844018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:44.844057 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:44.844061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:44.844646 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.844185    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:44.844646 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.844206    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:44.844646 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.844237    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret podName:a71f9c61-120c-4405-9649-feccff6b0788 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.844223873 +0000 UTC m=+66.162393017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret") pod "global-pull-secret-syncer-nvlc7" (UID: "a71f9c61-120c-4405-9649-feccff6b0788") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:25:44.844646 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.844272    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs podName:bbc5cad4-ec17-484f-a8d8-37f502f04480 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.844252312 +0000 UTC m=+66.162421461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs") pod "network-metrics-daemon-cqbmk" (UID: "bbc5cad4-ec17-484f-a8d8-37f502f04480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:25:44.945531 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:44.945474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:44.945717 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.945631    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:25:44.945717 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.945653    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:25:44.945717 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.945666    2579 projected.go:196] Error preparing data for projected volume kube-api-access-grskf for pod openshift-network-diagnostics/network-check-target-mt2pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:44.945867 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:44.945731    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf podName:02e2160e-ca70-4294-afe4-daac92821d0b nodeName:}" failed. No retries permitted until 2026-07-06 19:26:16.945712974 +0000 UTC m=+66.263882140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-grskf" (UniqueName: "kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf") pod "network-check-target-mt2pm" (UID: "02e2160e-ca70-4294-afe4-daac92821d0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:25:45.245496 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:45.245460    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:45.245681 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:45.245576    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:45.245786 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:45.245460    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:45.245910 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:45.245891    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:46.245436 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:46.245401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:46.245823 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:46.245538    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:47.245563 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:47.245528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:47.246120 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:47.245538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:47.246120 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:47.245676    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:47.246120 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:47.245699    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:48.245485 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:48.245454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:48.245669 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:48.245560    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:49.245741 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:49.245712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:49.245741 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:49.245741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:49.246426 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:49.245825    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:49.246426 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:49.245975    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:50.244867 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:50.244838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:50.245039 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:50.244938    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:50.427712 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:50.427682    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ca5a5-a639-40fa-a950-cfbb060c9ad4" containerID="873837b7f2794aef1e0fcbf0c0d1d0b6954ff638f62b0948e72584e293048662" exitCode=0
Jul 06 19:25:50.428141 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:50.427746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerDied","Data":"873837b7f2794aef1e0fcbf0c0d1d0b6954ff638f62b0948e72584e293048662"}
Jul 06 19:25:51.246633 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:51.246601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:51.246792 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:51.246672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:51.246792 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:51.246685    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:51.246792 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:51.246765    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:51.432588 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:51.432553    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7ca5a5-a639-40fa-a950-cfbb060c9ad4" containerID="176c020e8c330ece3bd7afd0902e4fb9053a56e838d02a6ef9149d7b03cbca1a" exitCode=0
Jul 06 19:25:51.432939 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:51.432627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerDied","Data":"176c020e8c330ece3bd7afd0902e4fb9053a56e838d02a6ef9149d7b03cbca1a"}
Jul 06 19:25:52.245288 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:52.245259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:52.245453 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:52.245358    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:52.438137 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:52.438087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rz49b" event={"ID":"7c7ca5a5-a639-40fa-a950-cfbb060c9ad4","Type":"ContainerStarted","Data":"d19e86c8ae57a92f368b9acf47be1427bd0aa04b098eefb2424cd9aebe71889b"}
Jul 06 19:25:52.462526 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:52.462479    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rz49b" podStartSLOduration=8.5732261 podStartE2EDuration="41.462464126s" totalImagesPullingTime="32.889238026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:52.462119877 +0000 UTC m=+41.780289033" watchObservedRunningTime="2026-07-06 19:25:52.462464126 +0000 UTC m=+41.780633291"
Jul 06 19:25:53.245283 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:53.245245    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:53.245477 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:53.245246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:53.245477 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:53.245364    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:53.245477 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:53.245436    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:54.245079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:54.245051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:54.245466 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:54.245159    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:55.245462 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:55.245427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:55.245822 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:55.245567    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:55.245822 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:55.245602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:55.245822 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:55.245680    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:56.245207 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:56.245172    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:56.245389 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:56.245276    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:57.245967 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:57.245930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:57.246375 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:57.246036    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:57.246375 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:57.246154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:57.246375 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:57.246289    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:58.245364 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:58.245328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:25:58.245561 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:58.245447    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt2pm" podUID="02e2160e-ca70-4294-afe4-daac92821d0b"
Jul 06 19:25:59.245722 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.245691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:25:59.246068 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:59.245838    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqbmk" podUID="bbc5cad4-ec17-484f-a8d8-37f502f04480"
Jul 06 19:25:59.246068 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.245879    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:25:59.246068 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:25:59.245969    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nvlc7" podUID="a71f9c61-120c-4405-9649-feccff6b0788"
Jul 06 19:25:59.394942 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.394919    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-210.ec2.internal" event="NodeReady"
Jul 06 19:25:59.395095 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.395032    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:25:59.451496 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.451459    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df77dbcc5-bjnsb"]
Jul 06 19:25:59.466512 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.466490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.469017 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.468988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-plcs2\""
Jul 06 19:25:59.469193 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.469047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:25:59.469193 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.469056    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:25:59.469193 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.469086    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:25:59.471943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.471922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df77dbcc5-bjnsb"]
Jul 06 19:25:59.474355 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.474333    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:25:59.485872 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.485847    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ttpzg"]
Jul 06 19:25:59.506754 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.506730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.509039 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.509013    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:25:59.509039 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.509013    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:25:59.509241 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.509043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:25:59.509336 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.509320    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:25:59.509407 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.509389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f282m\""
Jul 06 19:25:59.517622 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.517602    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dkmb4"]
Jul 06 19:25:59.537080 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.537054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttpzg"]
Jul 06 19:25:59.537198 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.537183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.539416 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.539368    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:25:59.539609 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.539588    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-khkrm\""
Jul 06 19:25:59.539713 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.539640    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:25:59.540894 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.540872    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dkmb4"]
Jul 06 19:25:59.585629 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.585599    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lzvlh"]
Jul 06 19:25:59.605266 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.605237    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzvlh"]
Jul 06 19:25:59.605381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.605325    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.607394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.607373    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:25:59.607516 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.607469    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:25:59.607618 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.607603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vrv2c\""
Jul 06 19:25:59.607693 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.607674    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:25:59.656905 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.656816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb2262ce-1c5f-4682-90ce-0a2ae431713d-ca-trust-extracted\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.656905 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.656869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb2262ce-1c5f-4682-90ce-0a2ae431713d-image-registry-private-configuration\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.656922    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb052699-8ada-4f93-992a-72ccf571ee2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.657083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.656967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-registry-tls\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.656984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb2262ce-1c5f-4682-90ce-0a2ae431713d-registry-certificates\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.656999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb2262ce-1c5f-4682-90ce-0a2ae431713d-installation-pull-secrets\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77v8n\" (UniqueName: \"kubernetes.io/projected/eb052699-8ada-4f93-992a-72ccf571ee2e-kube-api-access-77v8n\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.657083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657070    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb2262ce-1c5f-4682-90ce-0a2ae431713d-trusted-ca\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmm48\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-kube-api-access-cmm48\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb052699-8ada-4f93-992a-72ccf571ee2e-data-volume\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.657279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb052699-8ada-4f93-992a-72ccf571ee2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.657279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2255317d-b290-4f95-9383-34c3606cf66d-config-volume\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.657279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2255317d-b290-4f95-9383-34c3606cf66d-tmp-dir\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.657279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2255317d-b290-4f95-9383-34c3606cf66d-metrics-tls\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.657465 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-bound-sa-token\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.657465 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks98r\" (UniqueName: \"kubernetes.io/projected/2255317d-b290-4f95-9383-34c3606cf66d-kube-api-access-ks98r\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.657465 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.657314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb052699-8ada-4f93-992a-72ccf571ee2e-crio-socket\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.757723 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb052699-8ada-4f93-992a-72ccf571ee2e-crio-socket\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.757869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb2262ce-1c5f-4682-90ce-0a2ae431713d-ca-trust-extracted\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.757869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb2262ce-1c5f-4682-90ce-0a2ae431713d-image-registry-private-configuration\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.757869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb052699-8ada-4f93-992a-72ccf571ee2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.757869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfv6q\" (UniqueName: \"kubernetes.io/projected/9f04c054-8605-497e-85dd-1a6136b6bdd4-kube-api-access-zfv6q\") pod \"ingress-canary-lzvlh\" (UID: \"9f04c054-8605-497e-85dd-1a6136b6bdd4\") " pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.758045 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-registry-tls\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758045 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757903    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb052699-8ada-4f93-992a-72ccf571ee2e-crio-socket\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.758045 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.757954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb2262ce-1c5f-4682-90ce-0a2ae431713d-registry-certificates\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758227 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb2262ce-1c5f-4682-90ce-0a2ae431713d-installation-pull-secrets\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758227 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77v8n\" (UniqueName: \"kubernetes.io/projected/eb052699-8ada-4f93-992a-72ccf571ee2e-kube-api-access-77v8n\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.758227 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758168    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb2262ce-1c5f-4682-90ce-0a2ae431713d-ca-trust-extracted\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758227 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f04c054-8605-497e-85dd-1a6136b6bdd4-cert\") pod \"ingress-canary-lzvlh\" (UID: \"9f04c054-8605-497e-85dd-1a6136b6bdd4\") " pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.758227 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb2262ce-1c5f-4682-90ce-0a2ae431713d-trusted-ca\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm48\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-kube-api-access-cmm48\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb052699-8ada-4f93-992a-72ccf571ee2e-data-volume\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb052699-8ada-4f93-992a-72ccf571ee2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2255317d-b290-4f95-9383-34c3606cf66d-config-volume\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2255317d-b290-4f95-9383-34c3606cf66d-tmp-dir\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2255317d-b290-4f95-9383-34c3606cf66d-metrics-tls\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-bound-sa-token\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.758471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks98r\" (UniqueName: \"kubernetes.io/projected/2255317d-b290-4f95-9383-34c3606cf66d-kube-api-access-ks98r\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.758863 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758559    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb052699-8ada-4f93-992a-72ccf571ee2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.758863 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758818    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2255317d-b290-4f95-9383-34c3606cf66d-tmp-dir\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.758966 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.758880    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb2262ce-1c5f-4682-90ce-0a2ae431713d-registry-certificates\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.759485 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.759270    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2255317d-b290-4f95-9383-34c3606cf66d-config-volume\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.759653 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.759631    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb052699-8ada-4f93-992a-72ccf571ee2e-data-volume\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.759728 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.759714    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb2262ce-1c5f-4682-90ce-0a2ae431713d-trusted-ca\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.762369 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.762344    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb052699-8ada-4f93-992a-72ccf571ee2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.762369 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.762360    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2255317d-b290-4f95-9383-34c3606cf66d-metrics-tls\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.762499 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.762351    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb2262ce-1c5f-4682-90ce-0a2ae431713d-image-registry-private-configuration\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.762499 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.762389    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-registry-tls\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.762499 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.762413    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb2262ce-1c5f-4682-90ce-0a2ae431713d-installation-pull-secrets\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.766727 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.766705    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks98r\" (UniqueName: \"kubernetes.io/projected/2255317d-b290-4f95-9383-34c3606cf66d-kube-api-access-ks98r\") pod \"dns-default-dkmb4\" (UID: \"2255317d-b290-4f95-9383-34c3606cf66d\") " pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.766925 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.766909    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77v8n\" (UniqueName: \"kubernetes.io/projected/eb052699-8ada-4f93-992a-72ccf571ee2e-kube-api-access-77v8n\") pod \"insights-runtime-extractor-ttpzg\" (UID: \"eb052699-8ada-4f93-992a-72ccf571ee2e\") " pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.770516 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.770490    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmm48\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-kube-api-access-cmm48\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.770917 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.770901    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb2262ce-1c5f-4682-90ce-0a2ae431713d-bound-sa-token\") pod \"image-registry-5df77dbcc5-bjnsb\" (UID: \"fb2262ce-1c5f-4682-90ce-0a2ae431713d\") " pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.777493 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.777476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:25:59.815697 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.815670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttpzg"
Jul 06 19:25:59.846694 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.846661    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:25:59.858979 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.858949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv6q\" (UniqueName: \"kubernetes.io/projected/9f04c054-8605-497e-85dd-1a6136b6bdd4-kube-api-access-zfv6q\") pod \"ingress-canary-lzvlh\" (UID: \"9f04c054-8605-497e-85dd-1a6136b6bdd4\") " pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.859130 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.858993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f04c054-8605-497e-85dd-1a6136b6bdd4-cert\") pod \"ingress-canary-lzvlh\" (UID: \"9f04c054-8605-497e-85dd-1a6136b6bdd4\") " pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.861296 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.861273    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f04c054-8605-497e-85dd-1a6136b6bdd4-cert\") pod \"ingress-canary-lzvlh\" (UID: \"9f04c054-8605-497e-85dd-1a6136b6bdd4\") " pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.872993 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.872946    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfv6q\" (UniqueName: \"kubernetes.io/projected/9f04c054-8605-497e-85dd-1a6136b6bdd4-kube-api-access-zfv6q\") pod \"ingress-canary-lzvlh\" (UID: \"9f04c054-8605-497e-85dd-1a6136b6bdd4\") " pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:25:59.914024 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:25:59.913787    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzvlh"
Jul 06 19:26:00.030058 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.029873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df77dbcc5-bjnsb"]
Jul 06 19:26:00.034358 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:00.034315    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2262ce_1c5f_4682_90ce_0a2ae431713d.slice/crio-ff39af92a9ccbc62a5018424e4bf107a67c5581c5e853516ae95014425fb4e63 WatchSource:0}: Error finding container ff39af92a9ccbc62a5018424e4bf107a67c5581c5e853516ae95014425fb4e63: Status 404 returned error can't find the container with id ff39af92a9ccbc62a5018424e4bf107a67c5581c5e853516ae95014425fb4e63
Jul 06 19:26:00.048334 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.048249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttpzg"]
Jul 06 19:26:00.054896 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:00.054863    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb052699_8ada_4f93_992a_72ccf571ee2e.slice/crio-17271385bf32664a04bdebb013ec92f821dcd808fe35aed148e83e27db819941 WatchSource:0}: Error finding container 17271385bf32664a04bdebb013ec92f821dcd808fe35aed148e83e27db819941: Status 404 returned error can't find the container with id 17271385bf32664a04bdebb013ec92f821dcd808fe35aed148e83e27db819941
Jul 06 19:26:00.061253 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.061230    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dkmb4"]
Jul 06 19:26:00.244951 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.244872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:26:00.247150 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.247123    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:26:00.247603 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.247358    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkxjr\""
Jul 06 19:26:00.247603 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.247441    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:26:00.285876 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.285846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzvlh"]
Jul 06 19:26:00.290310 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:00.290276    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f04c054_8605_497e_85dd_1a6136b6bdd4.slice/crio-928131b0f5a988fb7706e988b58d611f7abbb8ba9cb9ee6a50e2e5617b541458 WatchSource:0}: Error finding container 928131b0f5a988fb7706e988b58d611f7abbb8ba9cb9ee6a50e2e5617b541458: Status 404 returned error can't find the container with id 928131b0f5a988fb7706e988b58d611f7abbb8ba9cb9ee6a50e2e5617b541458
Jul 06 19:26:00.456697 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.456657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttpzg" event={"ID":"eb052699-8ada-4f93-992a-72ccf571ee2e","Type":"ContainerStarted","Data":"17271385bf32664a04bdebb013ec92f821dcd808fe35aed148e83e27db819941"}
Jul 06 19:26:00.458071 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.458029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzvlh" event={"ID":"9f04c054-8605-497e-85dd-1a6136b6bdd4","Type":"ContainerStarted","Data":"928131b0f5a988fb7706e988b58d611f7abbb8ba9cb9ee6a50e2e5617b541458"}
Jul 06 19:26:00.459766 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.459741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb" event={"ID":"fb2262ce-1c5f-4682-90ce-0a2ae431713d","Type":"ContainerStarted","Data":"e017f063975eba4250b48837620deaa9cda5754ea0690065e770f89e04ee9a71"}
Jul 06 19:26:00.459865 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.459780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb" event={"ID":"fb2262ce-1c5f-4682-90ce-0a2ae431713d","Type":"ContainerStarted","Data":"ff39af92a9ccbc62a5018424e4bf107a67c5581c5e853516ae95014425fb4e63"}
Jul 06 19:26:00.459929 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.459873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:26:00.461226 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.461207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkmb4" event={"ID":"2255317d-b290-4f95-9383-34c3606cf66d","Type":"ContainerStarted","Data":"b33fd2bab2ef09ffdc43619cff97bb82b707d161a36a920df300b88414e5a7af"}
Jul 06 19:26:00.481722 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:00.481475    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb" podStartSLOduration=2.481454186 podStartE2EDuration="2.481454186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:00.481422121 +0000 UTC m=+49.799591288" watchObservedRunningTime="2026-07-06 19:26:00.481454186 +0000 UTC m=+49.799623353"
Jul 06 19:26:01.248508 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:01.247518    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:26:01.248508 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:01.247908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:26:01.250911 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:01.250797    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:26:01.251070 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:01.251055    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qhtzw\""
Jul 06 19:26:01.251424 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:01.251274    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:26:04.070281 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.070247    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"]
Jul 06 19:26:04.089495 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.089464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"]
Jul 06 19:26:04.089676 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.089602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:04.091910 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.091885    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 19:26:04.092044 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.091931    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ff2r2\""
Jul 06 19:26:04.195088 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.195053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b280768-634c-4cae-bb86-b25b273909d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gh4vz\" (UID: \"4b280768-634c-4cae-bb86-b25b273909d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:04.296299 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.296209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b280768-634c-4cae-bb86-b25b273909d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gh4vz\" (UID: \"4b280768-634c-4cae-bb86-b25b273909d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:04.296451 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:26:04.296366    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 19:26:04.296451 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:26:04.296429    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b280768-634c-4cae-bb86-b25b273909d6-tls-certificates podName:4b280768-634c-4cae-bb86-b25b273909d6 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:04.796411914 +0000 UTC m=+54.114581078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4b280768-634c-4cae-bb86-b25b273909d6-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-gh4vz" (UID: "4b280768-634c-4cae-bb86-b25b273909d6") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 19:26:04.799991 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.799949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b280768-634c-4cae-bb86-b25b273909d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gh4vz\" (UID: \"4b280768-634c-4cae-bb86-b25b273909d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:04.802680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:04.802652    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b280768-634c-4cae-bb86-b25b273909d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gh4vz\" (UID: \"4b280768-634c-4cae-bb86-b25b273909d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:05.000331 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:05.000296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:06.015379 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.015277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"]
Jul 06 19:26:06.480499 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.480458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttpzg" event={"ID":"eb052699-8ada-4f93-992a-72ccf571ee2e","Type":"ContainerStarted","Data":"777bb1473da59535290c95d1b1a9549d6c7c877668e8e0af4c0cbeac4d621f12"}
Jul 06 19:26:06.481558 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.481533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz" event={"ID":"4b280768-634c-4cae-bb86-b25b273909d6","Type":"ContainerStarted","Data":"c4a12082319ba66774c02102c66cf39095a051ee8dcd3450694fad7941b6d032"}
Jul 06 19:26:06.482879 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.482858    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzvlh" event={"ID":"9f04c054-8605-497e-85dd-1a6136b6bdd4","Type":"ContainerStarted","Data":"dd3d06cfad082ad780201c1dfec4fa9eaca71a3548a50adc176f8609577b4439"}
Jul 06 19:26:06.484559 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.484541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkmb4" event={"ID":"2255317d-b290-4f95-9383-34c3606cf66d","Type":"ContainerStarted","Data":"fe8a611b1d4b76ca19e695e080a0b957a5e1e577b84aa7db7576d388a828b9ab"}
Jul 06 19:26:06.484623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.484575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkmb4" event={"ID":"2255317d-b290-4f95-9383-34c3606cf66d","Type":"ContainerStarted","Data":"3446c789fbe447f3d38d285d4e28d508ca591e36fbefe66a3af9b48476fe560f"}
Jul 06 19:26:06.484680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.484667    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:26:06.502867 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.502822    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lzvlh" podStartSLOduration=1.916133238 podStartE2EDuration="7.502804057s" totalImagesPullingTime="5.586670819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.502142563 +0000 UTC m=+55.820311757" watchObservedRunningTime="2026-07-06 19:26:06.502804057 +0000 UTC m=+55.820973224"
Jul 06 19:26:06.521668 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:06.521628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dkmb4" podStartSLOduration=1.71421311 podStartE2EDuration="7.521611399s" totalImagesPullingTime="5.807398289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:06.520762085 +0000 UTC m=+55.838931274" watchObservedRunningTime="2026-07-06 19:26:06.521611399 +0000 UTC m=+55.839780577"
Jul 06 19:26:07.494460 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:07.494426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttpzg" event={"ID":"eb052699-8ada-4f93-992a-72ccf571ee2e","Type":"ContainerStarted","Data":"f5646979b2e149cf382f39d24c1b01eda954f46e037f346271c1c04fc0ef740b"}
Jul 06 19:26:07.496311 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:07.496245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz" event={"ID":"4b280768-634c-4cae-bb86-b25b273909d6","Type":"ContainerStarted","Data":"5de5df1c60e2e874ea1aaea19ebae9ac537ddcb1c1c493a77569f85e76786b5a"}
Jul 06 19:26:07.514237 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:07.514183    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz" podStartSLOduration=2.42658557 podStartE2EDuration="3.514165765s" totalImagesPullingTime="1.087580195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:07.513062397 +0000 UTC m=+56.831231579" watchObservedRunningTime="2026-07-06 19:26:07.514165765 +0000 UTC m=+56.832334932"
Jul 06 19:26:08.499857 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:08.499825    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:08.505195 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:08.505171    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gh4vz"
Jul 06 19:26:09.504310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:09.504276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttpzg" event={"ID":"eb052699-8ada-4f93-992a-72ccf571ee2e","Type":"ContainerStarted","Data":"55345ecd52575aa4119b196e7c9e71c11cb31a0166564ea2c1d3f89839cf6c55"}
Jul 06 19:26:09.524794 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:09.524750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ttpzg" podStartSLOduration=1.4317326879999999 podStartE2EDuration="10.524734724s" totalImagesPullingTime="9.093002036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:09.523731732 +0000 UTC m=+58.841900898" watchObservedRunningTime="2026-07-06 19:26:09.524734724 +0000 UTC m=+58.842903889"
Jul 06 19:26:11.414088 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:11.414063    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shkfb"
Jul 06 19:26:16.298300 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.298270    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"]
Jul 06 19:26:16.301450 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.301430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.303838 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.303820    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 19:26:16.303935 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.303910    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:26:16.303982 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.303918    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:26:16.304469 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.304446    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:26:16.304584 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.304474    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dlbjc\""
Jul 06 19:26:16.304584 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.304517    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:26:16.317853 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.317833    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"]
Jul 06 19:26:16.386674 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.386645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57132de-f3dd-4216-afa0-9f9277adb5e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.386801 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.386682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42wn2\" (UniqueName: \"kubernetes.io/projected/b57132de-f3dd-4216-afa0-9f9277adb5e8-kube-api-access-42wn2\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.386801 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.386709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b57132de-f3dd-4216-afa0-9f9277adb5e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.386801 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.386751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57132de-f3dd-4216-afa0-9f9277adb5e8-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.389340 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.389317    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rbvnm"]
Jul 06 19:26:16.391298 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.391282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.393380 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.393361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:26:16.394009 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.393992    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:26:16.394128 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.394058    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rm8wk\""
Jul 06 19:26:16.394128 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.394075    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:26:16.487952 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.487927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d57p6\" (UniqueName: \"kubernetes.io/projected/e38562d3-6be4-46a2-af41-149365fa30e7-kube-api-access-d57p6\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488091 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.487961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488091 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.487989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-root\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488091 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e38562d3-6be4-46a2-af41-149365fa30e7-metrics-client-ca\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488232 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57132de-f3dd-4216-afa0-9f9277adb5e8-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.488232 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488232 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-textfile\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488232 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-sys\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488232 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42wn2\" (UniqueName: \"kubernetes.io/projected/b57132de-f3dd-4216-afa0-9f9277adb5e8-kube-api-access-42wn2\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.488447 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57132de-f3dd-4216-afa0-9f9277adb5e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.488447 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-wtmp\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488447 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b57132de-f3dd-4216-afa0-9f9277adb5e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.488447 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-tls\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.488758 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.488742    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57132de-f3dd-4216-afa0-9f9277adb5e8-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.490831 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.490809    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57132de-f3dd-4216-afa0-9f9277adb5e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.490926 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.490841    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b57132de-f3dd-4216-afa0-9f9277adb5e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.498250 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.498229    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dkmb4"
Jul 06 19:26:16.501804 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.501786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42wn2\" (UniqueName: \"kubernetes.io/projected/b57132de-f3dd-4216-afa0-9f9277adb5e8-kube-api-access-42wn2\") pod \"openshift-state-metrics-54cf96dfcf-72nd5\" (UID: \"b57132de-f3dd-4216-afa0-9f9277adb5e8\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.588766 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-textfile\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588766 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588718    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-sys\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588766 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-wtmp\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588998 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-tls\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588998 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d57p6\" (UniqueName: \"kubernetes.io/projected/e38562d3-6be4-46a2-af41-149365fa30e7-kube-api-access-d57p6\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588998 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-sys\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588998 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588887    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-wtmp\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588998 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.588998 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.588978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-root\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.589285 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.589008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e38562d3-6be4-46a2-af41-149365fa30e7-metrics-client-ca\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.589285 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.589042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.589285 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.589051    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-textfile\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.589285 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.589131    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e38562d3-6be4-46a2-af41-149365fa30e7-root\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.589585 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.589567    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e38562d3-6be4-46a2-af41-149365fa30e7-metrics-client-ca\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.589694 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.589675    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.591280 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.591254    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-tls\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.591377 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.591287    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e38562d3-6be4-46a2-af41-149365fa30e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.610235 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.610202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"
Jul 06 19:26:16.628621 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.628598    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d57p6\" (UniqueName: \"kubernetes.io/projected/e38562d3-6be4-46a2-af41-149365fa30e7-kube-api-access-d57p6\") pod \"node-exporter-rbvnm\" (UID: \"e38562d3-6be4-46a2-af41-149365fa30e7\") " pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.699937 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.699908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbvnm"
Jul 06 19:26:16.711189 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:16.711160    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38562d3_6be4_46a2_af41_149365fa30e7.slice/crio-c047922615e0ed95ebc9d5a7c25d58520336d9bd375c55026184920d6f6e54b3 WatchSource:0}: Error finding container c047922615e0ed95ebc9d5a7c25d58520336d9bd375c55026184920d6f6e54b3: Status 404 returned error can't find the container with id c047922615e0ed95ebc9d5a7c25d58520336d9bd375c55026184920d6f6e54b3
Jul 06 19:26:16.743185 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.743155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5"]
Jul 06 19:26:16.746623 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:16.746594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57132de_f3dd_4216_afa0_9f9277adb5e8.slice/crio-c87e5681ac668aae1d7c0f9861fe6dc08e9d6aa410c1f6eabee6d2a4fa2d9211 WatchSource:0}: Error finding container c87e5681ac668aae1d7c0f9861fe6dc08e9d6aa410c1f6eabee6d2a4fa2d9211: Status 404 returned error can't find the container with id c87e5681ac668aae1d7c0f9861fe6dc08e9d6aa410c1f6eabee6d2a4fa2d9211
Jul 06 19:26:16.892481 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.892447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:26:16.892646 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.892505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:26:16.899920 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.899898    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:26:16.900810 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.900796    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:26:16.904961 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.904936    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbc5cad4-ec17-484f-a8d8-37f502f04480-metrics-certs\") pod \"network-metrics-daemon-cqbmk\" (UID: \"bbc5cad4-ec17-484f-a8d8-37f502f04480\") " pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:26:16.905052 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.904972    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a71f9c61-120c-4405-9649-feccff6b0788-original-pull-secret\") pod \"global-pull-secret-syncer-nvlc7\" (UID: \"a71f9c61-120c-4405-9649-feccff6b0788\") " pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:26:16.992832 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.992799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:26:16.995842 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:16.995824    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:26:17.005900 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.005880    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:26:17.017410 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.017390    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grskf\" (UniqueName: \"kubernetes.io/projected/02e2160e-ca70-4294-afe4-daac92821d0b-kube-api-access-grskf\") pod \"network-check-target-mt2pm\" (UID: \"02e2160e-ca70-4294-afe4-daac92821d0b\") " pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:26:17.057733 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.057709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkxjr\""
Jul 06 19:26:17.066414 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.066398    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:26:17.167668 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.167643    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qhtzw\""
Jul 06 19:26:17.174634 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.174610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nvlc7"
Jul 06 19:26:17.175667 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.175649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqbmk"
Jul 06 19:26:17.196877 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.196845    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mt2pm"]
Jul 06 19:26:17.201426 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:17.201403    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e2160e_ca70_4294_afe4_daac92821d0b.slice/crio-fbe013ead7fe72f3c34b00aa1557604295f4a0483f6ef67276c900f89590c0eb WatchSource:0}: Error finding container fbe013ead7fe72f3c34b00aa1557604295f4a0483f6ef67276c900f89590c0eb: Status 404 returned error can't find the container with id fbe013ead7fe72f3c34b00aa1557604295f4a0483f6ef67276c900f89590c0eb
Jul 06 19:26:17.321398 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.321367    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cqbmk"]
Jul 06 19:26:17.325032 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:17.325003    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc5cad4_ec17_484f_a8d8_37f502f04480.slice/crio-c34967ab2fae4354ff8a74af023d0c5863cb8811db4f48a5da7617c94b0abe3b WatchSource:0}: Error finding container c34967ab2fae4354ff8a74af023d0c5863cb8811db4f48a5da7617c94b0abe3b: Status 404 returned error can't find the container with id c34967ab2fae4354ff8a74af023d0c5863cb8811db4f48a5da7617c94b0abe3b
Jul 06 19:26:17.342091 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.342067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nvlc7"]
Jul 06 19:26:17.346028 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:17.345997    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71f9c61_120c_4405_9649_feccff6b0788.slice/crio-951f0bd996d5e67db38adda01de400c4e08034a60894ff1e1b48baf6fdd98c70 WatchSource:0}: Error finding container 951f0bd996d5e67db38adda01de400c4e08034a60894ff1e1b48baf6fdd98c70: Status 404 returned error can't find the container with id 951f0bd996d5e67db38adda01de400c4e08034a60894ff1e1b48baf6fdd98c70
Jul 06 19:26:17.529973 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.529939    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mt2pm" event={"ID":"02e2160e-ca70-4294-afe4-daac92821d0b","Type":"ContainerStarted","Data":"fbe013ead7fe72f3c34b00aa1557604295f4a0483f6ef67276c900f89590c0eb"}
Jul 06 19:26:17.531805 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.531769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5" event={"ID":"b57132de-f3dd-4216-afa0-9f9277adb5e8","Type":"ContainerStarted","Data":"0c648057412c0b43270eb9264d3930afbcaa964d8992b59ab0197ae270a56d90"}
Jul 06 19:26:17.531935 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.531838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5" event={"ID":"b57132de-f3dd-4216-afa0-9f9277adb5e8","Type":"ContainerStarted","Data":"cd4cebd29a5b93d895ec9473cdd26158d5319ae4b81d139174c3265187c55120"}
Jul 06 19:26:17.531935 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.531867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5" event={"ID":"b57132de-f3dd-4216-afa0-9f9277adb5e8","Type":"ContainerStarted","Data":"c87e5681ac668aae1d7c0f9861fe6dc08e9d6aa410c1f6eabee6d2a4fa2d9211"}
Jul 06 19:26:17.532936 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.532916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbvnm" event={"ID":"e38562d3-6be4-46a2-af41-149365fa30e7","Type":"ContainerStarted","Data":"c047922615e0ed95ebc9d5a7c25d58520336d9bd375c55026184920d6f6e54b3"}
Jul 06 19:26:17.533927 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.533903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqbmk" event={"ID":"bbc5cad4-ec17-484f-a8d8-37f502f04480","Type":"ContainerStarted","Data":"c34967ab2fae4354ff8a74af023d0c5863cb8811db4f48a5da7617c94b0abe3b"}
Jul 06 19:26:17.535165 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:17.535098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nvlc7" event={"ID":"a71f9c61-120c-4405-9649-feccff6b0788","Type":"ContainerStarted","Data":"951f0bd996d5e67db38adda01de400c4e08034a60894ff1e1b48baf6fdd98c70"}
Jul 06 19:26:18.542272 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:18.542227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5" event={"ID":"b57132de-f3dd-4216-afa0-9f9277adb5e8","Type":"ContainerStarted","Data":"7dc43fd59333c93508ff52f34a57e5024bf47929c2503423ec62db7f52d7c64b"}
Jul 06 19:26:18.544333 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:18.544283    2579 generic.go:356] "Generic (PLEG): container finished" podID="e38562d3-6be4-46a2-af41-149365fa30e7" containerID="85ae174f23e312835ed8807ea7e5209d19b747cec40fac3fd69063881e0a7fa3" exitCode=0
Jul 06 19:26:18.544333 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:18.544316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbvnm" event={"ID":"e38562d3-6be4-46a2-af41-149365fa30e7","Type":"ContainerDied","Data":"85ae174f23e312835ed8807ea7e5209d19b747cec40fac3fd69063881e0a7fa3"}
Jul 06 19:26:18.565199 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:18.565139    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-72nd5" podStartSLOduration=1.370799856 podStartE2EDuration="2.565099782s" totalImagesPullingTime="1.194299926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:18.564665598 +0000 UTC m=+67.882834801" watchObservedRunningTime="2026-07-06 19:26:18.565099782 +0000 UTC m=+67.883268949"
Jul 06 19:26:19.060850 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.060790    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-866c7956-zzwk7"]
Jul 06 19:26:19.063478 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.063455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.066192 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066166    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-llu4d7b66at4\""
Jul 06 19:26:19.066315 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066270    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 19:26:19.066315 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066293    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 19:26:19.066425 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066401    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 19:26:19.066473 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066449    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 19:26:19.066519 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066493    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 19:26:19.067761 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.066849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vnhzh\""
Jul 06 19:26:19.092186 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.092158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866c7956-zzwk7"]
Jul 06 19:26:19.114007 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.113936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114007 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.113991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-tls\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114161 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.114019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-grpc-tls\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114161 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.114095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114161 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.114147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114325 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.114185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114325 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.114257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79fb4f3a-85c1-4b10-9287-516d9dead414-metrics-client-ca\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.114325 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.114290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qhn\" (UniqueName: \"kubernetes.io/projected/79fb4f3a-85c1-4b10-9287-516d9dead414-kube-api-access-k8qhn\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.214999 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.214969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79fb4f3a-85c1-4b10-9287-516d9dead414-metrics-client-ca\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qhn\" (UniqueName: \"kubernetes.io/projected/79fb4f3a-85c1-4b10-9287-516d9dead414-kube-api-access-k8qhn\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-tls\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-grpc-tls\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215205 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.215962 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.215905    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79fb4f3a-85c1-4b10-9287-516d9dead414-metrics-client-ca\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.218283 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.218238    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.218379 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.218355    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.218450 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.218418    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.218517 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.218440    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-grpc-tls\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.219071 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.219045    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.219168 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.219055    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79fb4f3a-85c1-4b10-9287-516d9dead414-secret-thanos-querier-tls\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.226426 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.226404    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qhn\" (UniqueName: \"kubernetes.io/projected/79fb4f3a-85c1-4b10-9287-516d9dead414-kube-api-access-k8qhn\") pod \"thanos-querier-866c7956-zzwk7\" (UID: \"79fb4f3a-85c1-4b10-9287-516d9dead414\") " pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.374968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.374865    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:19.530240 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.530054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866c7956-zzwk7"]
Jul 06 19:26:19.533194 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:19.533164    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fb4f3a_85c1_4b10_9287_516d9dead414.slice/crio-c2f44d63f19c68facbdfa27a08546483359bc7ca6c3a27e9ad850168f2730eac WatchSource:0}: Error finding container c2f44d63f19c68facbdfa27a08546483359bc7ca6c3a27e9ad850168f2730eac: Status 404 returned error can't find the container with id c2f44d63f19c68facbdfa27a08546483359bc7ca6c3a27e9ad850168f2730eac
Jul 06 19:26:19.549460 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.549426    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"c2f44d63f19c68facbdfa27a08546483359bc7ca6c3a27e9ad850168f2730eac"}
Jul 06 19:26:19.552639 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.552573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbvnm" event={"ID":"e38562d3-6be4-46a2-af41-149365fa30e7","Type":"ContainerStarted","Data":"fea6329be04a353e0edb949671d68e35659335e9dbbb21b255dd064ce8a9a359"}
Jul 06 19:26:19.552639 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.552632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbvnm" event={"ID":"e38562d3-6be4-46a2-af41-149365fa30e7","Type":"ContainerStarted","Data":"452ddf81d2bc166d4ce4f10a264aae1f3c24902bb174663992d0658f4828f091"}
Jul 06 19:26:19.555313 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.555288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqbmk" event={"ID":"bbc5cad4-ec17-484f-a8d8-37f502f04480","Type":"ContainerStarted","Data":"f83b5a85541c186f55c09a80fd183e415c1b92b6a81ad722f1806e04bec7a2aa"}
Jul 06 19:26:19.555426 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.555338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqbmk" event={"ID":"bbc5cad4-ec17-484f-a8d8-37f502f04480","Type":"ContainerStarted","Data":"0de59752edb5b230f187da7b1fbf3ff0f3bfbf4cd7249cb3e31d5bfb819b0101"}
Jul 06 19:26:19.575306 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.575252    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rbvnm" podStartSLOduration=2.161832229 podStartE2EDuration="3.575204858s" totalImagesPullingTime="1.325804146s" totalInitContainerRuntime="87.568483ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:19.574314541 +0000 UTC m=+68.892483767" watchObservedRunningTime="2026-07-06 19:26:19.575204858 +0000 UTC m=+68.893374025"
Jul 06 19:26:19.783328 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.783255    2579 patch_prober.go:28] interesting pod/image-registry-5df77dbcc5-bjnsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:26:19.783328 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:19.783327    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb" podUID="fb2262ce-1c5f-4682-90ce-0a2ae431713d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:26:20.404328 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.404268    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cqbmk" podStartSLOduration=68.176617547 podStartE2EDuration="1m9.404251275s" totalImagesPullingTime="1.227633728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:19.590959025 +0000 UTC m=+68.909128207" watchObservedRunningTime="2026-07-06 19:26:20.404251275 +0000 UTC m=+69.722420442"
Jul 06 19:26:20.404507 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.404429    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"]
Jul 06 19:26:20.406579 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.406553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:20.409071 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.409034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:26:20.409071 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.409063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jgpxf\""
Jul 06 19:26:20.418930 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.418903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"]
Jul 06 19:26:20.526192 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.526151    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4203a4e6-7b85-41ef-a354-0aed7da7af8d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:20.526374 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.526207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-665cs\" (UniqueName: \"kubernetes.io/projected/4203a4e6-7b85-41ef-a354-0aed7da7af8d-kube-api-access-665cs\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:20.627372 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.627324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4203a4e6-7b85-41ef-a354-0aed7da7af8d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:20.627852 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.627385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-665cs\" (UniqueName: \"kubernetes.io/projected/4203a4e6-7b85-41ef-a354-0aed7da7af8d-kube-api-access-665cs\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:20.627852 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:26:20.627704    2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 19:26:20.627852 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:26:20.627765    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4203a4e6-7b85-41ef-a354-0aed7da7af8d-monitoring-plugin-cert podName:4203a4e6-7b85-41ef-a354-0aed7da7af8d nodeName:}" failed. No retries permitted until 2026-07-06 19:26:21.127745052 +0000 UTC m=+70.445914215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/4203a4e6-7b85-41ef-a354-0aed7da7af8d-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-kzngc" (UID: "4203a4e6-7b85-41ef-a354-0aed7da7af8d") : secret "monitoring-plugin-cert" not found
Jul 06 19:26:20.639899 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:20.639865    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-665cs\" (UniqueName: \"kubernetes.io/projected/4203a4e6-7b85-41ef-a354-0aed7da7af8d-kube-api-access-665cs\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:21.130021 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.129960    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54b5949b66-9spvn"]
Jul 06 19:26:21.132355 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.132333    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.133170 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.132977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4203a4e6-7b85-41ef-a354-0aed7da7af8d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:21.135165 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.135052    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9c156pftq4c11\""
Jul 06 19:26:21.135165 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.135118    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t6z8f\""
Jul 06 19:26:21.135900 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.135881    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 19:26:21.136009 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.135942    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 19:26:21.136077 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.136034    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 19:26:21.136217 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.136194    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 19:26:21.136665 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.136558    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4203a4e6-7b85-41ef-a354-0aed7da7af8d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kzngc\" (UID: \"4203a4e6-7b85-41ef-a354-0aed7da7af8d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:21.147325 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.147238    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54b5949b66-9spvn"]
Jul 06 19:26:21.233722 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.233682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb842bee-f45c-4218-9edb-25ccd3939802-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.233953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.233734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-client-ca-bundle\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.233953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.233773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rtnn\" (UniqueName: \"kubernetes.io/projected/cb842bee-f45c-4218-9edb-25ccd3939802-kube-api-access-7rtnn\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.233953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.233851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb842bee-f45c-4218-9edb-25ccd3939802-audit-log\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.233953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.233931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-secret-metrics-server-client-certs\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.234306 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.233982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-secret-metrics-server-tls\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.234306 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.234006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb842bee-f45c-4218-9edb-25ccd3939802-metrics-server-audit-profiles\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.318016 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.317982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:21.334880 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.334841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb842bee-f45c-4218-9edb-25ccd3939802-metrics-server-audit-profiles\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.335048 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.335002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb842bee-f45c-4218-9edb-25ccd3939802-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.335181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.335047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-client-ca-bundle\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.335181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.335080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rtnn\" (UniqueName: \"kubernetes.io/projected/cb842bee-f45c-4218-9edb-25ccd3939802-kube-api-access-7rtnn\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.335181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.335139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb842bee-f45c-4218-9edb-25ccd3939802-audit-log\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.335181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.335178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-secret-metrics-server-client-certs\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.335399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.335228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-secret-metrics-server-tls\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.336739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.336082    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cb842bee-f45c-4218-9edb-25ccd3939802-metrics-server-audit-profiles\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.336739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.336574    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb842bee-f45c-4218-9edb-25ccd3939802-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.336739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.336701    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cb842bee-f45c-4218-9edb-25ccd3939802-audit-log\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.338010 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.337986    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-client-ca-bundle\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.338096 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.338081    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-secret-metrics-server-tls\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.339651 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.339626    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cb842bee-f45c-4218-9edb-25ccd3939802-secret-metrics-server-client-certs\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.345175 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.345143    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rtnn\" (UniqueName: \"kubernetes.io/projected/cb842bee-f45c-4218-9edb-25ccd3939802-kube-api-access-7rtnn\") pod \"metrics-server-54b5949b66-9spvn\" (UID: \"cb842bee-f45c-4218-9edb-25ccd3939802\") " pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.454489 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.454446    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:21.470695 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:21.470668    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5df77dbcc5-bjnsb"
Jul 06 19:26:23.075413 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.075382    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54b5949b66-9spvn"]
Jul 06 19:26:23.085946 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:23.085916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb842bee_f45c_4218_9edb_25ccd3939802.slice/crio-a079150becf8df0a5e4fce3e316eddce73bb00d20717ea0f3c0ee343ed7044c8 WatchSource:0}: Error finding container a079150becf8df0a5e4fce3e316eddce73bb00d20717ea0f3c0ee343ed7044c8: Status 404 returned error can't find the container with id a079150becf8df0a5e4fce3e316eddce73bb00d20717ea0f3c0ee343ed7044c8
Jul 06 19:26:23.092671 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.092645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"]
Jul 06 19:26:23.102513 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:26:23.102487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4203a4e6_7b85_41ef_a354_0aed7da7af8d.slice/crio-4f2dda0c80451e374e1575d5eaa9076c6be281c78fb4b8d4171db302b62aac4b WatchSource:0}: Error finding container 4f2dda0c80451e374e1575d5eaa9076c6be281c78fb4b8d4171db302b62aac4b: Status 404 returned error can't find the container with id 4f2dda0c80451e374e1575d5eaa9076c6be281c78fb4b8d4171db302b62aac4b
Jul 06 19:26:23.576463 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.576365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mt2pm" event={"ID":"02e2160e-ca70-4294-afe4-daac92821d0b","Type":"ContainerStarted","Data":"6704889a120a06ae40d3ec66023cd2c244a73852262e13f0e853dac2a515d9d3"}
Jul 06 19:26:23.576618 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.576512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:26:23.578387 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.578361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"55be7091d1613a288178598e510cc96481a074616b4d009ae2b8a825b31f3dab"}
Jul 06 19:26:23.578523 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.578421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"ec4cb4a99cf738944a197029897d41b74176b45a62c91498d447632ffea4286d"}
Jul 06 19:26:23.578523 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.578463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"2eb53a94deee243da20d50d54a15dfedf2abcea317ca1ddc697bc55041503fde"}
Jul 06 19:26:23.579603 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.579575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn" event={"ID":"cb842bee-f45c-4218-9edb-25ccd3939802","Type":"ContainerStarted","Data":"a079150becf8df0a5e4fce3e316eddce73bb00d20717ea0f3c0ee343ed7044c8"}
Jul 06 19:26:23.580705 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.580689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc" event={"ID":"4203a4e6-7b85-41ef-a354-0aed7da7af8d","Type":"ContainerStarted","Data":"4f2dda0c80451e374e1575d5eaa9076c6be281c78fb4b8d4171db302b62aac4b"}
Jul 06 19:26:23.581903 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.581886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nvlc7" event={"ID":"a71f9c61-120c-4405-9649-feccff6b0788","Type":"ContainerStarted","Data":"e20a80f4f5f80f5846667ab79bb384a21af0f8c2f73bb133add0922bbc7c025f"}
Jul 06 19:26:23.594279 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.594238    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mt2pm" podStartSLOduration=66.906856799 podStartE2EDuration="1m12.594220578s" totalImagesPullingTime="5.687363779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:23.592847899 +0000 UTC m=+72.911017068" watchObservedRunningTime="2026-07-06 19:26:23.594220578 +0000 UTC m=+72.912389771"
Jul 06 19:26:23.609870 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:23.609825    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nvlc7" podStartSLOduration=67.067204462 podStartE2EDuration="1m12.6098101s" totalImagesPullingTime="5.542605638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:23.609610455 +0000 UTC m=+72.927779648" watchObservedRunningTime="2026-07-06 19:26:23.6098101 +0000 UTC m=+72.927979266"
Jul 06 19:26:25.593649 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.593609    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"8302bd3bc6d05915496af612f2d5753023971a64e39981d46f3fcc2d5e6e5b0d"}
Jul 06 19:26:25.594097 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.593694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"a65ffe2c41455852c76b5d960fd4f13964ef6436ea1077250b6be7719e56bdcd"}
Jul 06 19:26:25.594097 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.593739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" event={"ID":"79fb4f3a-85c1-4b10-9287-516d9dead414","Type":"ContainerStarted","Data":"6c992038558f4ddf7762f99f6de6237ea200c3362d9c3c19213878d9129b1bb1"}
Jul 06 19:26:25.594097 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.593783    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:25.595278 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.595255    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn" event={"ID":"cb842bee-f45c-4218-9edb-25ccd3939802","Type":"ContainerStarted","Data":"4fe44a28c869835697a23c7b2a584f51095c556ee4c4fde2b2b1fbe4405225b6"}
Jul 06 19:26:25.596539 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.596519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc" event={"ID":"4203a4e6-7b85-41ef-a354-0aed7da7af8d","Type":"ContainerStarted","Data":"59b4576393ac122be16f9bc5cc348ad295024a1d333e02fe7d7fe34dd2a100ac"}
Jul 06 19:26:25.596747 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.596732    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:25.601419 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.601401    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc"
Jul 06 19:26:25.620459 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.620418    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7" podStartSLOduration=1.418356048 podStartE2EDuration="6.620402709s" totalImagesPullingTime="5.202046661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:25.619770664 +0000 UTC m=+74.937939831" watchObservedRunningTime="2026-07-06 19:26:25.620402709 +0000 UTC m=+74.938571903"
Jul 06 19:26:25.639047 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.638998    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn" podStartSLOduration=2.654635238 podStartE2EDuration="4.638981012s" totalImagesPullingTime="1.984345774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:25.637476177 +0000 UTC m=+74.955645344" watchObservedRunningTime="2026-07-06 19:26:25.638981012 +0000 UTC m=+74.957150182"
Jul 06 19:26:25.653615 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:25.653579    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kzngc" podStartSLOduration=3.68791921 podStartE2EDuration="5.653567058s" totalImagesPullingTime="1.965647848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:25.653135011 +0000 UTC m=+74.971304199" watchObservedRunningTime="2026-07-06 19:26:25.653567058 +0000 UTC m=+74.971736223"
Jul 06 19:26:31.606173 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:31.606143    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-866c7956-zzwk7"
Jul 06 19:26:41.454775 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:41.454670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:41.454775 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:41.454730    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:26:54.589619 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:26:54.589585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mt2pm"
Jul 06 19:27:01.460628 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:27:01.460597    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:27:01.464397 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:27:01.464379    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54b5949b66-9spvn"
Jul 06 19:30:11.093469 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:30:11.093440    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:33:35.619475 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.619444    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"]
Jul 06 19:33:35.621602 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.621587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.624827 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.624808    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:33:35.625542 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.625517    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:33:35.625650 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.625550    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n4x9f\""
Jul 06 19:33:35.632350 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.632329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"]
Jul 06 19:33:35.759324 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.759289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvph\" (UniqueName: \"kubernetes.io/projected/8016060d-257c-4217-a2be-2487633b8352-kube-api-access-hfvph\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.759324 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.759329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.759540 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.759375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.860610 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.860577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.860783 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.860641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvph\" (UniqueName: \"kubernetes.io/projected/8016060d-257c-4217-a2be-2487633b8352-kube-api-access-hfvph\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.860783 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.860670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.860973 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.860955    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.861012 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.860983    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.870335 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.870271    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvph\" (UniqueName: \"kubernetes.io/projected/8016060d-257c-4217-a2be-2487633b8352-kube-api-access-hfvph\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:35.930818 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:35.930768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:36.056072 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:36.056049    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"]
Jul 06 19:33:36.058163 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:33:36.058138    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8016060d_257c_4217_a2be_2487633b8352.slice/crio-1cb55c99530dee33bc93b653d42c53f347b63445a7be716821b509b962864379 WatchSource:0}: Error finding container 1cb55c99530dee33bc93b653d42c53f347b63445a7be716821b509b962864379: Status 404 returned error can't find the container with id 1cb55c99530dee33bc93b653d42c53f347b63445a7be716821b509b962864379
Jul 06 19:33:36.060390 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:36.060376    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:33:37.054272 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:37.054218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9" event={"ID":"8016060d-257c-4217-a2be-2487633b8352","Type":"ContainerStarted","Data":"1cb55c99530dee33bc93b653d42c53f347b63445a7be716821b509b962864379"}
Jul 06 19:33:44.081762 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:44.081728    2579 generic.go:356] "Generic (PLEG): container finished" podID="8016060d-257c-4217-a2be-2487633b8352" containerID="e26b332d82150083de27d8364e7e657712e83cefc227ae59f9fd70b9a8c35adf" exitCode=0
Jul 06 19:33:44.082247 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:44.081791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9" event={"ID":"8016060d-257c-4217-a2be-2487633b8352","Type":"ContainerDied","Data":"e26b332d82150083de27d8364e7e657712e83cefc227ae59f9fd70b9a8c35adf"}
Jul 06 19:33:46.092154 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:46.092126    2579 generic.go:356] "Generic (PLEG): container finished" podID="8016060d-257c-4217-a2be-2487633b8352" containerID="23039dd7042e8aa095b091b3636cd045898867e5bdb7fa088d5bb047dc764b67" exitCode=0
Jul 06 19:33:46.092563 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:46.092178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9" event={"ID":"8016060d-257c-4217-a2be-2487633b8352","Type":"ContainerDied","Data":"23039dd7042e8aa095b091b3636cd045898867e5bdb7fa088d5bb047dc764b67"}
Jul 06 19:33:55.126818 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:55.126784    2579 generic.go:356] "Generic (PLEG): container finished" podID="8016060d-257c-4217-a2be-2487633b8352" containerID="5c1d041f6a9636057176dfdf3331688ef8a1490836b5895d609c69e341844ab4" exitCode=0
Jul 06 19:33:55.127192 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:55.126848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9" event={"ID":"8016060d-257c-4217-a2be-2487633b8352","Type":"ContainerDied","Data":"5c1d041f6a9636057176dfdf3331688ef8a1490836b5895d609c69e341844ab4"}
Jul 06 19:33:56.253989 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.253961    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:56.303731 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.303708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-bundle\") pod \"8016060d-257c-4217-a2be-2487633b8352\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") "
Jul 06 19:33:56.303909 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.303757    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfvph\" (UniqueName: \"kubernetes.io/projected/8016060d-257c-4217-a2be-2487633b8352-kube-api-access-hfvph\") pod \"8016060d-257c-4217-a2be-2487633b8352\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") "
Jul 06 19:33:56.303909 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.303791    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-util\") pod \"8016060d-257c-4217-a2be-2487633b8352\" (UID: \"8016060d-257c-4217-a2be-2487633b8352\") "
Jul 06 19:33:56.304497 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.304470    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-bundle" (OuterVolumeSpecName: "bundle") pod "8016060d-257c-4217-a2be-2487633b8352" (UID: "8016060d-257c-4217-a2be-2487633b8352"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:56.305935 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.305907    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8016060d-257c-4217-a2be-2487633b8352-kube-api-access-hfvph" (OuterVolumeSpecName: "kube-api-access-hfvph") pod "8016060d-257c-4217-a2be-2487633b8352" (UID: "8016060d-257c-4217-a2be-2487633b8352"). InnerVolumeSpecName "kube-api-access-hfvph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:33:56.308170 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.308148    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-util" (OuterVolumeSpecName: "util") pod "8016060d-257c-4217-a2be-2487633b8352" (UID: "8016060d-257c-4217-a2be-2487633b8352"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:56.405051 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.405008    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:33:56.405051 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.405049    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8016060d-257c-4217-a2be-2487633b8352-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:33:56.405051 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:56.405059    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfvph\" (UniqueName: \"kubernetes.io/projected/8016060d-257c-4217-a2be-2487633b8352-kube-api-access-hfvph\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:33:57.134942 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:57.134907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9" event={"ID":"8016060d-257c-4217-a2be-2487633b8352","Type":"ContainerDied","Data":"1cb55c99530dee33bc93b653d42c53f347b63445a7be716821b509b962864379"}
Jul 06 19:33:57.134942 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:57.134942    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540f2vn9"
Jul 06 19:33:57.135167 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:33:57.134998    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cb55c99530dee33bc93b653d42c53f347b63445a7be716821b509b962864379"
Jul 06 19:34:03.649728 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649655    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"]
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649898    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="util"
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649908    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="util"
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649919    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="extract"
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649925    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="extract"
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649935    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="pull"
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649940    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="pull"
Jul 06 19:34:03.650079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.649994    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8016060d-257c-4217-a2be-2487633b8352" containerName="extract"
Jul 06 19:34:03.651773 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.651758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.656012 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.655990    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 19:34:03.656144 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.656034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-c8jz7\""
Jul 06 19:34:03.656144 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.656033    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:34:03.666622 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.666601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"]
Jul 06 19:34:03.761231 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.761202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55f51d7d-366a-48fc-aa39-f551235d4a4b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t74xs\" (UID: \"55f51d7d-366a-48fc-aa39-f551235d4a4b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.761378 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.761241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4gsx\" (UniqueName: \"kubernetes.io/projected/55f51d7d-366a-48fc-aa39-f551235d4a4b-kube-api-access-b4gsx\") pod \"cert-manager-operator-controller-manager-55c444bf86-t74xs\" (UID: \"55f51d7d-366a-48fc-aa39-f551235d4a4b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.862485 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.862452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55f51d7d-366a-48fc-aa39-f551235d4a4b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t74xs\" (UID: \"55f51d7d-366a-48fc-aa39-f551235d4a4b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.862622 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.862507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4gsx\" (UniqueName: \"kubernetes.io/projected/55f51d7d-366a-48fc-aa39-f551235d4a4b-kube-api-access-b4gsx\") pod \"cert-manager-operator-controller-manager-55c444bf86-t74xs\" (UID: \"55f51d7d-366a-48fc-aa39-f551235d4a4b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.862954 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.862934    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55f51d7d-366a-48fc-aa39-f551235d4a4b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-t74xs\" (UID: \"55f51d7d-366a-48fc-aa39-f551235d4a4b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.871683 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.871662    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4gsx\" (UniqueName: \"kubernetes.io/projected/55f51d7d-366a-48fc-aa39-f551235d4a4b-kube-api-access-b4gsx\") pod \"cert-manager-operator-controller-manager-55c444bf86-t74xs\" (UID: \"55f51d7d-366a-48fc-aa39-f551235d4a4b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:03.960298 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:03.960215    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"
Jul 06 19:34:04.086596 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:04.086563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs"]
Jul 06 19:34:04.089291 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:04.089262    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f51d7d_366a_48fc_aa39_f551235d4a4b.slice/crio-130320bfa7cae4e97d00725370faa8523c914a95342ec6cf97273c9d699ee3ad WatchSource:0}: Error finding container 130320bfa7cae4e97d00725370faa8523c914a95342ec6cf97273c9d699ee3ad: Status 404 returned error can't find the container with id 130320bfa7cae4e97d00725370faa8523c914a95342ec6cf97273c9d699ee3ad
Jul 06 19:34:04.159789 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:04.159757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs" event={"ID":"55f51d7d-366a-48fc-aa39-f551235d4a4b","Type":"ContainerStarted","Data":"130320bfa7cae4e97d00725370faa8523c914a95342ec6cf97273c9d699ee3ad"}
Jul 06 19:34:06.169047 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:06.169005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs" event={"ID":"55f51d7d-366a-48fc-aa39-f551235d4a4b","Type":"ContainerStarted","Data":"e9d92d03fed77565a6741ad1cba91b612e122370685b244bc73d96a352d3f0cd"}
Jul 06 19:34:06.191672 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:06.191615    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-t74xs" podStartSLOduration=1.7657756820000001 podStartE2EDuration="3.191597154s" totalImagesPullingTime="1.425821472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:06.190734144 +0000 UTC m=+535.508903311" watchObservedRunningTime="2026-07-06 19:34:06.191597154 +0000 UTC m=+535.509766321"
Jul 06 19:34:07.322076 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.322047    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"]
Jul 06 19:34:07.324324 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.324307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.326720 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.326701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:34:07.326817 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.326745    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:34:07.327508 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.327494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n4x9f\""
Jul 06 19:34:07.335699 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.335680    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"]
Jul 06 19:34:07.392199 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.392166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svd47\" (UniqueName: \"kubernetes.io/projected/09786e37-929a-4676-9b61-db116e3eb1c4-kube-api-access-svd47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.392199 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.392200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.392412 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.392231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.493427 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.493391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svd47\" (UniqueName: \"kubernetes.io/projected/09786e37-929a-4676-9b61-db116e3eb1c4-kube-api-access-svd47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.493427 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.493431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.493619 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.493458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.493836 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.493815    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.493874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.493851    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.504951 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.504930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svd47\" (UniqueName: \"kubernetes.io/projected/09786e37-929a-4676-9b61-db116e3eb1c4-kube-api-access-svd47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.581331 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.581263    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v4wmh"]
Jul 06 19:34:07.583324 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.583307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.585100 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.585084    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:34:07.585373 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.585357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:34:07.585436 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.585363    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9fkb8\""
Jul 06 19:34:07.594912 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.594887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v4wmh"]
Jul 06 19:34:07.632735 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.632687    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:07.695125 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.695082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a824526-1db0-4963-b1ce-8fbf504d2284-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v4wmh\" (UID: \"9a824526-1db0-4963-b1ce-8fbf504d2284\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.695274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.695218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtttd\" (UniqueName: \"kubernetes.io/projected/9a824526-1db0-4963-b1ce-8fbf504d2284-kube-api-access-rtttd\") pod \"cert-manager-webhook-6486ffd997-v4wmh\" (UID: \"9a824526-1db0-4963-b1ce-8fbf504d2284\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.760761 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.760606    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"]
Jul 06 19:34:07.763324 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:07.763295    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09786e37_929a_4676_9b61_db116e3eb1c4.slice/crio-68611817671e4d155a4d48afe4863554617430cbd0ec819a975a25c0ad07c1ec WatchSource:0}: Error finding container 68611817671e4d155a4d48afe4863554617430cbd0ec819a975a25c0ad07c1ec: Status 404 returned error can't find the container with id 68611817671e4d155a4d48afe4863554617430cbd0ec819a975a25c0ad07c1ec
Jul 06 19:34:07.796156 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.796132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtttd\" (UniqueName: \"kubernetes.io/projected/9a824526-1db0-4963-b1ce-8fbf504d2284-kube-api-access-rtttd\") pod \"cert-manager-webhook-6486ffd997-v4wmh\" (UID: \"9a824526-1db0-4963-b1ce-8fbf504d2284\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.796268 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.796182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a824526-1db0-4963-b1ce-8fbf504d2284-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v4wmh\" (UID: \"9a824526-1db0-4963-b1ce-8fbf504d2284\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.804592 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.804565    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a824526-1db0-4963-b1ce-8fbf504d2284-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v4wmh\" (UID: \"9a824526-1db0-4963-b1ce-8fbf504d2284\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.805271 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.805253    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtttd\" (UniqueName: \"kubernetes.io/projected/9a824526-1db0-4963-b1ce-8fbf504d2284-kube-api-access-rtttd\") pod \"cert-manager-webhook-6486ffd997-v4wmh\" (UID: \"9a824526-1db0-4963-b1ce-8fbf504d2284\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:07.903943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:07.903913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:08.032038 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:08.032002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v4wmh"]
Jul 06 19:34:08.034298 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:08.034266    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a824526_1db0_4963_b1ce_8fbf504d2284.slice/crio-b93c578d3cecb1cce2604c0944b0f01956f324416d62fc039532eada9e425aea WatchSource:0}: Error finding container b93c578d3cecb1cce2604c0944b0f01956f324416d62fc039532eada9e425aea: Status 404 returned error can't find the container with id b93c578d3cecb1cce2604c0944b0f01956f324416d62fc039532eada9e425aea
Jul 06 19:34:08.178342 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:08.178309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh" event={"ID":"9a824526-1db0-4963-b1ce-8fbf504d2284","Type":"ContainerStarted","Data":"b93c578d3cecb1cce2604c0944b0f01956f324416d62fc039532eada9e425aea"}
Jul 06 19:34:08.179632 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:08.179610    2579 generic.go:356] "Generic (PLEG): container finished" podID="09786e37-929a-4676-9b61-db116e3eb1c4" containerID="d2cf6ac2748382dd06dca1b9b9a2df6965295fbc61802480c2c16cc0ea033c3f" exitCode=0
Jul 06 19:34:08.179752 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:08.179655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm" event={"ID":"09786e37-929a-4676-9b61-db116e3eb1c4","Type":"ContainerDied","Data":"d2cf6ac2748382dd06dca1b9b9a2df6965295fbc61802480c2c16cc0ea033c3f"}
Jul 06 19:34:08.179752 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:08.179685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm" event={"ID":"09786e37-929a-4676-9b61-db116e3eb1c4","Type":"ContainerStarted","Data":"68611817671e4d155a4d48afe4863554617430cbd0ec819a975a25c0ad07c1ec"}
Jul 06 19:34:09.574750 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.574715    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4989b"]
Jul 06 19:34:09.583291 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.583266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.585658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.585635    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7sdcb\""
Jul 06 19:34:09.589606 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.589537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4989b"]
Jul 06 19:34:09.711697 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.711662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd3f300b-50ec-42d0-9f02-f45e2da10d07-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4989b\" (UID: \"fd3f300b-50ec-42d0-9f02-f45e2da10d07\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.711875 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.711728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcdjt\" (UniqueName: \"kubernetes.io/projected/fd3f300b-50ec-42d0-9f02-f45e2da10d07-kube-api-access-xcdjt\") pod \"cert-manager-cainjector-559cdd8c87-4989b\" (UID: \"fd3f300b-50ec-42d0-9f02-f45e2da10d07\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.813079 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.813037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd3f300b-50ec-42d0-9f02-f45e2da10d07-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4989b\" (UID: \"fd3f300b-50ec-42d0-9f02-f45e2da10d07\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.813276 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.813098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcdjt\" (UniqueName: \"kubernetes.io/projected/fd3f300b-50ec-42d0-9f02-f45e2da10d07-kube-api-access-xcdjt\") pod \"cert-manager-cainjector-559cdd8c87-4989b\" (UID: \"fd3f300b-50ec-42d0-9f02-f45e2da10d07\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.824310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.824257    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd3f300b-50ec-42d0-9f02-f45e2da10d07-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4989b\" (UID: \"fd3f300b-50ec-42d0-9f02-f45e2da10d07\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.824569 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.824545    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcdjt\" (UniqueName: \"kubernetes.io/projected/fd3f300b-50ec-42d0-9f02-f45e2da10d07-kube-api-access-xcdjt\") pod \"cert-manager-cainjector-559cdd8c87-4989b\" (UID: \"fd3f300b-50ec-42d0-9f02-f45e2da10d07\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:09.897561 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:09.897523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b"
Jul 06 19:34:11.194992 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:11.194823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh" event={"ID":"9a824526-1db0-4963-b1ce-8fbf504d2284","Type":"ContainerStarted","Data":"232bf16084bf6f5a369a44f39d74b6313ff2df28ef17d27ab751acbb8b032bb1"}
Jul 06 19:34:11.194992 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:11.194905    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:11.197062 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:11.197009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm" event={"ID":"09786e37-929a-4676-9b61-db116e3eb1c4","Type":"ContainerStarted","Data":"5695182a6a0816bdd40faa0c51648303cf1b8f89064cbd821e627568b7309d3d"}
Jul 06 19:34:11.208942 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:11.208918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4989b"]
Jul 06 19:34:11.212458 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:11.212427    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd3f300b_50ec_42d0_9f02_f45e2da10d07.slice/crio-01c1f842e5d65085c173f71bf894d3a4fefe1093a750939b6f29f95ae51e30b9 WatchSource:0}: Error finding container 01c1f842e5d65085c173f71bf894d3a4fefe1093a750939b6f29f95ae51e30b9: Status 404 returned error can't find the container with id 01c1f842e5d65085c173f71bf894d3a4fefe1093a750939b6f29f95ae51e30b9
Jul 06 19:34:11.213578 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:11.213528    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh" podStartSLOduration=1.179883612 podStartE2EDuration="4.213508721s" totalImagesPullingTime="3.033625109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:11.211891852 +0000 UTC m=+540.530061020" watchObservedRunningTime="2026-07-06 19:34:11.213508721 +0000 UTC m=+540.531677887"
Jul 06 19:34:12.203172 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:12.203138    2579 generic.go:356] "Generic (PLEG): container finished" podID="09786e37-929a-4676-9b61-db116e3eb1c4" containerID="5695182a6a0816bdd40faa0c51648303cf1b8f89064cbd821e627568b7309d3d" exitCode=0
Jul 06 19:34:12.203574 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:12.203222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm" event={"ID":"09786e37-929a-4676-9b61-db116e3eb1c4","Type":"ContainerDied","Data":"5695182a6a0816bdd40faa0c51648303cf1b8f89064cbd821e627568b7309d3d"}
Jul 06 19:34:12.204876 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:12.204772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b" event={"ID":"fd3f300b-50ec-42d0-9f02-f45e2da10d07","Type":"ContainerStarted","Data":"d09ef0d9fb7c076fd3f87b40048823bd34c4caa4bd76c85daa22aa3684e5089b"}
Jul 06 19:34:12.204876 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:12.204806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b" event={"ID":"fd3f300b-50ec-42d0-9f02-f45e2da10d07","Type":"ContainerStarted","Data":"01c1f842e5d65085c173f71bf894d3a4fefe1093a750939b6f29f95ae51e30b9"}
Jul 06 19:34:12.240890 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:12.240839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4989b" podStartSLOduration=3.240823986 podStartE2EDuration="3.240823986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:12.239632729 +0000 UTC m=+541.557801896" watchObservedRunningTime="2026-07-06 19:34:12.240823986 +0000 UTC m=+541.558993152"
Jul 06 19:34:13.211214 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:13.211179    2579 generic.go:356] "Generic (PLEG): container finished" podID="09786e37-929a-4676-9b61-db116e3eb1c4" containerID="67209d9a603d65eb2a711d940a92c6bcbe0c39d3787bd85e7131395b55dcb55b" exitCode=0
Jul 06 19:34:13.211584 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:13.211218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm" event={"ID":"09786e37-929a-4676-9b61-db116e3eb1c4","Type":"ContainerDied","Data":"67209d9a603d65eb2a711d940a92c6bcbe0c39d3787bd85e7131395b55dcb55b"}
Jul 06 19:34:14.342353 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.342330    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:14.449944 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.449914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svd47\" (UniqueName: \"kubernetes.io/projected/09786e37-929a-4676-9b61-db116e3eb1c4-kube-api-access-svd47\") pod \"09786e37-929a-4676-9b61-db116e3eb1c4\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") "
Jul 06 19:34:14.450080 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.450005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-bundle\") pod \"09786e37-929a-4676-9b61-db116e3eb1c4\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") "
Jul 06 19:34:14.450080 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.450027    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-util\") pod \"09786e37-929a-4676-9b61-db116e3eb1c4\" (UID: \"09786e37-929a-4676-9b61-db116e3eb1c4\") "
Jul 06 19:34:14.450419 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.450398    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-bundle" (OuterVolumeSpecName: "bundle") pod "09786e37-929a-4676-9b61-db116e3eb1c4" (UID: "09786e37-929a-4676-9b61-db116e3eb1c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:34:14.451980 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.451955    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09786e37-929a-4676-9b61-db116e3eb1c4-kube-api-access-svd47" (OuterVolumeSpecName: "kube-api-access-svd47") pod "09786e37-929a-4676-9b61-db116e3eb1c4" (UID: "09786e37-929a-4676-9b61-db116e3eb1c4"). InnerVolumeSpecName "kube-api-access-svd47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:14.455419 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.455388    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-util" (OuterVolumeSpecName: "util") pod "09786e37-929a-4676-9b61-db116e3eb1c4" (UID: "09786e37-929a-4676-9b61-db116e3eb1c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:34:14.551184 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.551075    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:34:14.551184 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.551120    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09786e37-929a-4676-9b61-db116e3eb1c4-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:34:14.551184 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:14.551133    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svd47\" (UniqueName: \"kubernetes.io/projected/09786e37-929a-4676-9b61-db116e3eb1c4-kube-api-access-svd47\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:34:15.221623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:15.221589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm" event={"ID":"09786e37-929a-4676-9b61-db116e3eb1c4","Type":"ContainerDied","Data":"68611817671e4d155a4d48afe4863554617430cbd0ec819a975a25c0ad07c1ec"}
Jul 06 19:34:15.221791 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:15.221632    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjz8dm"
Jul 06 19:34:15.221791 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:15.221639    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68611817671e4d155a4d48afe4863554617430cbd0ec819a975a25c0ad07c1ec"
Jul 06 19:34:17.207586 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:17.207556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v4wmh"
Jul 06 19:34:18.550879 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.550843    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nfr9g"]
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551153    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="pull"
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551164    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="pull"
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551172    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="extract"
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551178    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="extract"
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551187    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="util"
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551193    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="util"
Jul 06 19:34:18.551290 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.551232    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="09786e37-929a-4676-9b61-db116e3eb1c4" containerName="extract"
Jul 06 19:34:18.553256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.553240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.556124 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.556089    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ldh86\""
Jul 06 19:34:18.563914 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.563896    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nfr9g"]
Jul 06 19:34:18.683975 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.683943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c-bound-sa-token\") pod \"cert-manager-55b4d954d5-nfr9g\" (UID: \"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c\") " pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.684155 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.684006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcpw5\" (UniqueName: \"kubernetes.io/projected/9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c-kube-api-access-tcpw5\") pod \"cert-manager-55b4d954d5-nfr9g\" (UID: \"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c\") " pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.785392 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.785351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcpw5\" (UniqueName: \"kubernetes.io/projected/9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c-kube-api-access-tcpw5\") pod \"cert-manager-55b4d954d5-nfr9g\" (UID: \"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c\") " pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.785589 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.785427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c-bound-sa-token\") pod \"cert-manager-55b4d954d5-nfr9g\" (UID: \"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c\") " pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.794329 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.794304    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c-bound-sa-token\") pod \"cert-manager-55b4d954d5-nfr9g\" (UID: \"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c\") " pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.794459 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.794444    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcpw5\" (UniqueName: \"kubernetes.io/projected/9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c-kube-api-access-tcpw5\") pod \"cert-manager-55b4d954d5-nfr9g\" (UID: \"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c\") " pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.861417 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.861334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nfr9g"
Jul 06 19:34:18.985090 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:18.985068    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nfr9g"]
Jul 06 19:34:18.987091 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:18.987063    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9991f90e_ad2a_4a1d_a9a2_2c1cc45bd24c.slice/crio-b82b3bf79c6a2500fd3d8d8c51d3cc653f8a4425db48423513ed613804c9db26 WatchSource:0}: Error finding container b82b3bf79c6a2500fd3d8d8c51d3cc653f8a4425db48423513ed613804c9db26: Status 404 returned error can't find the container with id b82b3bf79c6a2500fd3d8d8c51d3cc653f8a4425db48423513ed613804c9db26
Jul 06 19:34:19.239968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:19.239934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nfr9g" event={"ID":"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c","Type":"ContainerStarted","Data":"11759e73140cd2a230ded0df7bb3f62af3783efaff45fe3acbe7948d37c8ee3d"}
Jul 06 19:34:19.239968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:19.239973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nfr9g" event={"ID":"9991f90e-ad2a-4a1d-a9a2-2c1cc45bd24c","Type":"ContainerStarted","Data":"b82b3bf79c6a2500fd3d8d8c51d3cc653f8a4425db48423513ed613804c9db26"}
Jul 06 19:34:19.262319 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:19.262275    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nfr9g" podStartSLOduration=1.262260336 podStartE2EDuration="1.262260336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:19.260747235 +0000 UTC m=+548.578916430" watchObservedRunningTime="2026-07-06 19:34:19.262260336 +0000 UTC m=+548.580429502"
Jul 06 19:34:27.763524 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.763488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"]
Jul 06 19:34:27.768372 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.768353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.770919 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.770901    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:34:27.771036 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.770941    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:34:27.771036 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.770948    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n4x9f\""
Jul 06 19:34:27.775700 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.775682    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"]
Jul 06 19:34:27.859609 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.859579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.859762 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.859620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcg7x\" (UniqueName: \"kubernetes.io/projected/b3c82788-9bea-4edb-882b-0360a404d82c-kube-api-access-jcg7x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.859762 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.859717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.960739 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.960699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcg7x\" (UniqueName: \"kubernetes.io/projected/b3c82788-9bea-4edb-882b-0360a404d82c-kube-api-access-jcg7x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.960909 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.960766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.960909 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.960806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.961161 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.961146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.961219 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.961202    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:27.969529 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:27.969499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcg7x\" (UniqueName: \"kubernetes.io/projected/b3c82788-9bea-4edb-882b-0360a404d82c-kube-api-access-jcg7x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:28.077968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:28.077877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:28.203990 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:28.203963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"]
Jul 06 19:34:28.206263 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:28.206233    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c82788_9bea_4edb_882b_0360a404d82c.slice/crio-a015386286680e0f09d39d239a8764bb52f32f4e7e27ed29c565c8b8c1d2ee4b WatchSource:0}: Error finding container a015386286680e0f09d39d239a8764bb52f32f4e7e27ed29c565c8b8c1d2ee4b: Status 404 returned error can't find the container with id a015386286680e0f09d39d239a8764bb52f32f4e7e27ed29c565c8b8c1d2ee4b
Jul 06 19:34:28.280535 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:28.280505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6" event={"ID":"b3c82788-9bea-4edb-882b-0360a404d82c","Type":"ContainerStarted","Data":"046f8bfeccdde4ba84e70bedd12389f6a775b4fa0ff087c50c4b7d9a523471c4"}
Jul 06 19:34:28.280656 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:28.280551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6" event={"ID":"b3c82788-9bea-4edb-882b-0360a404d82c","Type":"ContainerStarted","Data":"a015386286680e0f09d39d239a8764bb52f32f4e7e27ed29c565c8b8c1d2ee4b"}
Jul 06 19:34:29.285838 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:29.285757    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3c82788-9bea-4edb-882b-0360a404d82c" containerID="046f8bfeccdde4ba84e70bedd12389f6a775b4fa0ff087c50c4b7d9a523471c4" exitCode=0
Jul 06 19:34:29.285838 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:29.285803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6" event={"ID":"b3c82788-9bea-4edb-882b-0360a404d82c","Type":"ContainerDied","Data":"046f8bfeccdde4ba84e70bedd12389f6a775b4fa0ff087c50c4b7d9a523471c4"}
Jul 06 19:34:30.291640 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:30.291606    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3c82788-9bea-4edb-882b-0360a404d82c" containerID="bd390805433b1e6b2168f118d5c639f3ded2e6b458800b698697a5999cbd75b5" exitCode=0
Jul 06 19:34:30.292015 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:30.291644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6" event={"ID":"b3c82788-9bea-4edb-882b-0360a404d82c","Type":"ContainerDied","Data":"bd390805433b1e6b2168f118d5c639f3ded2e6b458800b698697a5999cbd75b5"}
Jul 06 19:34:31.297341 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:31.297309    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3c82788-9bea-4edb-882b-0360a404d82c" containerID="a6054c9bd7c0fee2ed6c9b83235c43f477b029707ea75ef01d9c66e35cff163f" exitCode=0
Jul 06 19:34:31.297715 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:31.297354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6" event={"ID":"b3c82788-9bea-4edb-882b-0360a404d82c","Type":"ContainerDied","Data":"a6054c9bd7c0fee2ed6c9b83235c43f477b029707ea75ef01d9c66e35cff163f"}
Jul 06 19:34:32.421555 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.421526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:32.499080 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.499051    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcg7x\" (UniqueName: \"kubernetes.io/projected/b3c82788-9bea-4edb-882b-0360a404d82c-kube-api-access-jcg7x\") pod \"b3c82788-9bea-4edb-882b-0360a404d82c\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") "
Jul 06 19:34:32.499247 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.499126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-util\") pod \"b3c82788-9bea-4edb-882b-0360a404d82c\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") "
Jul 06 19:34:32.499247 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.499158    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-bundle\") pod \"b3c82788-9bea-4edb-882b-0360a404d82c\" (UID: \"b3c82788-9bea-4edb-882b-0360a404d82c\") "
Jul 06 19:34:32.499832 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.499807    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-bundle" (OuterVolumeSpecName: "bundle") pod "b3c82788-9bea-4edb-882b-0360a404d82c" (UID: "b3c82788-9bea-4edb-882b-0360a404d82c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:34:32.501065 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.501035    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c82788-9bea-4edb-882b-0360a404d82c-kube-api-access-jcg7x" (OuterVolumeSpecName: "kube-api-access-jcg7x") pod "b3c82788-9bea-4edb-882b-0360a404d82c" (UID: "b3c82788-9bea-4edb-882b-0360a404d82c"). InnerVolumeSpecName "kube-api-access-jcg7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:32.505645 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.505626    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-util" (OuterVolumeSpecName: "util") pod "b3c82788-9bea-4edb-882b-0360a404d82c" (UID: "b3c82788-9bea-4edb-882b-0360a404d82c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:34:32.600182 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.600072    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcg7x\" (UniqueName: \"kubernetes.io/projected/b3c82788-9bea-4edb-882b-0360a404d82c-kube-api-access-jcg7x\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:34:32.600182 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.600099    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:34:32.600182 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:32.600135    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3c82788-9bea-4edb-882b-0360a404d82c-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:34:33.306578 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:33.306550    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6"
Jul 06 19:34:33.306578 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:33.306571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw85z6" event={"ID":"b3c82788-9bea-4edb-882b-0360a404d82c","Type":"ContainerDied","Data":"a015386286680e0f09d39d239a8764bb52f32f4e7e27ed29c565c8b8c1d2ee4b"}
Jul 06 19:34:33.306778 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:33.306612    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a015386286680e0f09d39d239a8764bb52f32f4e7e27ed29c565c8b8c1d2ee4b"
Jul 06 19:34:44.906852 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.906817    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"]
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907086    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="extract"
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907096    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="extract"
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="util"
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907130    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="util"
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907137    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="pull"
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907142    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="pull"
Jul 06 19:34:44.907275 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.907185    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c82788-9bea-4edb-882b-0360a404d82c" containerName="extract"
Jul 06 19:34:44.909780 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.909766    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:44.912342 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.912319    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:34:44.912342 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.912319    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pk84c\""
Jul 06 19:34:44.912524 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.912349    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:34:44.912524 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.912313    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:34:44.912524 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.912491    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:34:44.921840 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:44.921818    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"]
Jul 06 19:34:45.101015 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.100978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07221883-95a2-47e6-b374-f979d64c2804-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.101015 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.101015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07221883-95a2-47e6-b374-f979d64c2804-webhook-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.101277 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.101036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07221883-95a2-47e6-b374-f979d64c2804-manifests\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.101277 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.101129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07221883-95a2-47e6-b374-f979d64c2804-tmp\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.101277 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.101182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9lls\" (UniqueName: \"kubernetes.io/projected/07221883-95a2-47e6-b374-f979d64c2804-kube-api-access-s9lls\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.202409 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.202318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07221883-95a2-47e6-b374-f979d64c2804-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.202409 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.202362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07221883-95a2-47e6-b374-f979d64c2804-webhook-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.202409 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.202388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07221883-95a2-47e6-b374-f979d64c2804-manifests\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.202684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.202417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07221883-95a2-47e6-b374-f979d64c2804-tmp\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.202684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.202449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9lls\" (UniqueName: \"kubernetes.io/projected/07221883-95a2-47e6-b374-f979d64c2804-kube-api-access-s9lls\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.202812 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.202784    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07221883-95a2-47e6-b374-f979d64c2804-manifests\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.204743 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.204717    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07221883-95a2-47e6-b374-f979d64c2804-tmp\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.204948 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.204932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07221883-95a2-47e6-b374-f979d64c2804-webhook-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.204993 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.204932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07221883-95a2-47e6-b374-f979d64c2804-apiservice-cert\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.210742 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.210721    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9lls\" (UniqueName: \"kubernetes.io/projected/07221883-95a2-47e6-b374-f979d64c2804-kube-api-access-s9lls\") pod \"opendatahub-operator-controller-manager-849ccdb5-647c8\" (UID: \"07221883-95a2-47e6-b374-f979d64c2804\") " pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.220563 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.220545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:45.352267 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:45.352241    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"]
Jul 06 19:34:45.357209 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:34:45.357181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07221883_95a2_47e6_b374_f979d64c2804.slice/crio-d463ea5600d5c19fe561ec4f2726ee588b717d94ee2ad727c3b1b815ac01e847 WatchSource:0}: Error finding container d463ea5600d5c19fe561ec4f2726ee588b717d94ee2ad727c3b1b815ac01e847: Status 404 returned error can't find the container with id d463ea5600d5c19fe561ec4f2726ee588b717d94ee2ad727c3b1b815ac01e847
Jul 06 19:34:46.361077 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:46.361023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8" event={"ID":"07221883-95a2-47e6-b374-f979d64c2804","Type":"ContainerStarted","Data":"d463ea5600d5c19fe561ec4f2726ee588b717d94ee2ad727c3b1b815ac01e847"}
Jul 06 19:34:48.374826 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:48.374789    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8" event={"ID":"07221883-95a2-47e6-b374-f979d64c2804","Type":"ContainerStarted","Data":"93d89df96a467743208661a1f1a17958d191c57d0fc867546bb4fd9ded39a4e9"}
Jul 06 19:34:50.384967 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:50.384935    2579 generic.go:356] "Generic (PLEG): container finished" podID="07221883-95a2-47e6-b374-f979d64c2804" containerID="93d89df96a467743208661a1f1a17958d191c57d0fc867546bb4fd9ded39a4e9" exitCode=0
Jul 06 19:34:50.385360 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:50.384986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8" event={"ID":"07221883-95a2-47e6-b374-f979d64c2804","Type":"ContainerDied","Data":"93d89df96a467743208661a1f1a17958d191c57d0fc867546bb4fd9ded39a4e9"}
Jul 06 19:34:51.390587 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:51.390550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8" event={"ID":"07221883-95a2-47e6-b374-f979d64c2804","Type":"ContainerStarted","Data":"184648d461a4d76a374dc6bba2e3fe85ef1cd7dc71ee5ecea6d981278d849aab"}
Jul 06 19:34:51.390981 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:51.390773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:34:51.416230 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:34:51.416187    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8" podStartSLOduration=3.122760217 podStartE2EDuration="7.416175057s" totalImagesPullingTime="3.216362807s" totalInitContainerRuntime="1.077052033s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:51.414945087 +0000 UTC m=+580.733114274" watchObservedRunningTime="2026-07-06 19:34:51.416175057 +0000 UTC m=+580.734344223"
Jul 06 19:35:02.397671 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:02.397640    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-849ccdb5-647c8"
Jul 06 19:35:04.569392 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.569353    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"]
Jul 06 19:35:04.593420 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.593397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"]
Jul 06 19:35:04.593583 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.593485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.598869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.598843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:35:04.599209 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.599189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:35:04.599335 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.599290    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:35:04.599406 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.599291    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:35:04.605599 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.605580    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rtg6g\""
Jul 06 19:35:04.644705 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.644673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3c89ed-73f2-48d7-bffe-a6754da541e0-tls-certs\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.644884 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.644719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg7ch\" (UniqueName: \"kubernetes.io/projected/bc3c89ed-73f2-48d7-bffe-a6754da541e0-kube-api-access-rg7ch\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.644884 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.644737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc3c89ed-73f2-48d7-bffe-a6754da541e0-tmp\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.743284 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.743249    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dwcht"]
Jul 06 19:35:04.745856 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.745837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc3c89ed-73f2-48d7-bffe-a6754da541e0-tmp\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.745917 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.745900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3c89ed-73f2-48d7-bffe-a6754da541e0-tls-certs\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.745965 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.745949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg7ch\" (UniqueName: \"kubernetes.io/projected/bc3c89ed-73f2-48d7-bffe-a6754da541e0-kube-api-access-rg7ch\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.748120 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.748088    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc3c89ed-73f2-48d7-bffe-a6754da541e0-tmp\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.748315 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.748298    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3c89ed-73f2-48d7-bffe-a6754da541e0-tls-certs\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.763474 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.763444    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg7ch\" (UniqueName: \"kubernetes.io/projected/bc3c89ed-73f2-48d7-bffe-a6754da541e0-kube-api-access-rg7ch\") pod \"kube-auth-proxy-6568d8f747-jnl9w\" (UID: \"bc3c89ed-73f2-48d7-bffe-a6754da541e0\") " pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.789986 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.789959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dwcht"]
Jul 06 19:35:04.790138 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.790064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:04.793831 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.793809    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:35:04.793966 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.793887    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zhgl2\""
Jul 06 19:35:04.847334 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.847256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v8tz\" (UniqueName: \"kubernetes.io/projected/ad4f0481-d168-4170-a987-3b55ec7c2a6c-kube-api-access-5v8tz\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:04.847334 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.847304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad4f0481-d168-4170-a987-3b55ec7c2a6c-cert\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:04.903040 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.903010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"
Jul 06 19:35:04.947796 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.947769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad4f0481-d168-4170-a987-3b55ec7c2a6c-cert\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:04.947937 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.947866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8tz\" (UniqueName: \"kubernetes.io/projected/ad4f0481-d168-4170-a987-3b55ec7c2a6c-kube-api-access-5v8tz\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:04.948010 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:35:04.947948    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 19:35:04.948062 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:35:04.948038    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4f0481-d168-4170-a987-3b55ec7c2a6c-cert podName:ad4f0481-d168-4170-a987-3b55ec7c2a6c nodeName:}" failed. No retries permitted until 2026-07-06 19:35:05.448021102 +0000 UTC m=+594.766190250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad4f0481-d168-4170-a987-3b55ec7c2a6c-cert") pod "odh-model-controller-7998c67dc4-dwcht" (UID: "ad4f0481-d168-4170-a987-3b55ec7c2a6c") : secret "odh-model-controller-webhook-cert" not found
Jul 06 19:35:04.959696 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:04.959673    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v8tz\" (UniqueName: \"kubernetes.io/projected/ad4f0481-d168-4170-a987-3b55ec7c2a6c-kube-api-access-5v8tz\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:05.061306 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:05.061285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w"]
Jul 06 19:35:05.063545 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:35:05.063519    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3c89ed_73f2_48d7_bffe_a6754da541e0.slice/crio-8b3225c5584a1ae224ef61aa22627f5796eee7c7a70f9729996e8057e56c6d56 WatchSource:0}: Error finding container 8b3225c5584a1ae224ef61aa22627f5796eee7c7a70f9729996e8057e56c6d56: Status 404 returned error can't find the container with id 8b3225c5584a1ae224ef61aa22627f5796eee7c7a70f9729996e8057e56c6d56
Jul 06 19:35:05.449830 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:05.449796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w" event={"ID":"bc3c89ed-73f2-48d7-bffe-a6754da541e0","Type":"ContainerStarted","Data":"8b3225c5584a1ae224ef61aa22627f5796eee7c7a70f9729996e8057e56c6d56"}
Jul 06 19:35:05.452268 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:05.452247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad4f0481-d168-4170-a987-3b55ec7c2a6c-cert\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:05.454644 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:05.454586    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad4f0481-d168-4170-a987-3b55ec7c2a6c-cert\") pod \"odh-model-controller-7998c67dc4-dwcht\" (UID: \"ad4f0481-d168-4170-a987-3b55ec7c2a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:05.700611 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:05.700533    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:05.837622 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:05.837597    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dwcht"]
Jul 06 19:35:05.840556 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:35:05.840516    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4f0481_d168_4170_a987_3b55ec7c2a6c.slice/crio-0a471090a18762624cd53b44d90e6f7ec64d52db9d0727c2f1f5e92b8d2fb057 WatchSource:0}: Error finding container 0a471090a18762624cd53b44d90e6f7ec64d52db9d0727c2f1f5e92b8d2fb057: Status 404 returned error can't find the container with id 0a471090a18762624cd53b44d90e6f7ec64d52db9d0727c2f1f5e92b8d2fb057
Jul 06 19:35:06.111981 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.111906    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"]
Jul 06 19:35:06.114700 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.114684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.117028 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.116998    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:35:06.117159 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.117114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:35:06.117159 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.117138    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:35:06.117287 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.117249    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:35:06.117428 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.117411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z454h\""
Jul 06 19:35:06.129732 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.129709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"]
Jul 06 19:35:06.158015 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.157987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.158204 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.158072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-cacerts\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.158204 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.158093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.158204 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.158160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfn2\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-kube-api-access-sjfn2\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.158381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.158201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-local-certs\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.158381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.158228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.158381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.158303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-token\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.258781 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.258747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.258978 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.258797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-cacerts\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.258978 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.258814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.258978 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.258833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfn2\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-kube-api-access-sjfn2\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.258978 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.258855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-local-certs\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.259204 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.258975    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.259204 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.259038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-token\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.259587 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.259551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.261548 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.261519    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.261548 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.261526    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-local-certs\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.261680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.261525    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-cacerts\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.261680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.261635    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.267060 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.267033    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-token\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.267351 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.267332    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfn2\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-kube-api-access-sjfn2\") pod \"istiod-openshift-gateway-7574459656-2rwfr\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.424127 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.424070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:06.457480 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.457447    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht" event={"ID":"ad4f0481-d168-4170-a987-3b55ec7c2a6c","Type":"ContainerStarted","Data":"0a471090a18762624cd53b44d90e6f7ec64d52db9d0727c2f1f5e92b8d2fb057"}
Jul 06 19:35:06.571911 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:06.571875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"]
Jul 06 19:35:06.577742 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:35:06.577701    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf302c412_a3c1_4c46_bfb1_7ff2baa11de2.slice/crio-b6709aee48c421f334b4bc13d59acb1749503231b2779b3027c5e919e27813e2 WatchSource:0}: Error finding container b6709aee48c421f334b4bc13d59acb1749503231b2779b3027c5e919e27813e2: Status 404 returned error can't find the container with id b6709aee48c421f334b4bc13d59acb1749503231b2779b3027c5e919e27813e2
Jul 06 19:35:07.465255 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:07.465210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" event={"ID":"f302c412-a3c1-4c46-bfb1-7ff2baa11de2","Type":"ContainerStarted","Data":"b6709aee48c421f334b4bc13d59acb1749503231b2779b3027c5e919e27813e2"}
Jul 06 19:35:08.474457 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:08.474395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w" event={"ID":"bc3c89ed-73f2-48d7-bffe-a6754da541e0","Type":"ContainerStarted","Data":"7446e46f94f1b629b047c7143d2498a0591e64e29d7625a1a6a4344d89ce4162"}
Jul 06 19:35:08.494937 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:08.494886    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6568d8f747-jnl9w" podStartSLOduration=1.857272342 podStartE2EDuration="4.494865282s" totalImagesPullingTime="2.63759294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:08.491334096 +0000 UTC m=+597.809503300" watchObservedRunningTime="2026-07-06 19:35:08.494865282 +0000 UTC m=+597.813034450"
Jul 06 19:35:10.216282 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.216245    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:10.216654 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.216307    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:10.487571 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.487474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht" event={"ID":"ad4f0481-d168-4170-a987-3b55ec7c2a6c","Type":"ContainerStarted","Data":"69eda11469d228df6166cb6836503232847ec2ac7fa1eb8f158223072c0f32c9"}
Jul 06 19:35:10.487736 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.487700    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:35:10.489390 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.489363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" event={"ID":"f302c412-a3c1-4c46-bfb1-7ff2baa11de2","Type":"ContainerStarted","Data":"7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9"}
Jul 06 19:35:10.489594 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.489467    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:10.505412 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.505361    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht" podStartSLOduration=2.13740017 podStartE2EDuration="6.505340729s" totalImagesPullingTime="4.367940559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:10.502917607 +0000 UTC m=+599.821086798" watchObservedRunningTime="2026-07-06 19:35:10.505340729 +0000 UTC m=+599.823509896"
Jul 06 19:35:10.528435 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:10.528381    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" podStartSLOduration=0.892834778 podStartE2EDuration="4.528365491s" totalImagesPullingTime="3.635530713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:10.526851908 +0000 UTC m=+599.845021074" watchObservedRunningTime="2026-07-06 19:35:10.528365491 +0000 UTC m=+599.846534657"
Jul 06 19:35:11.495973 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:11.495937    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-2rwfr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:35:11.496385 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:11.496012    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" podUID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:35:14.250164 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.250128    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"]
Jul 06 19:35:14.253390 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.253372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334448 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd9dm\" (UniqueName: \"kubernetes.io/projected/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-kube-api-access-wd9dm\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.334626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.334571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.370993 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.370952    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"]
Jul 06 19:35:14.435502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd9dm\" (UniqueName: \"kubernetes.io/projected/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-kube-api-access-wd9dm\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.435502 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.435744 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.435744 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.435744 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.435744 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.435744 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.435650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.436568 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.436534    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.438263 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.438230    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.438358 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.438304    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.438358 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.438324    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.438572 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.438552    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.459015 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.458994    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd9dm\" (UniqueName: \"kubernetes.io/projected/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-kube-api-access-wd9dm\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.463210 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.463192    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1990d0fe-cc71-4c8b-9c4e-8e6237a314b3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2kf7h\" (UID: \"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.496006 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.495975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:14.564409 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.564297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:14.728706 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.728680    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"]
Jul 06 19:35:14.730770 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:35:14.730738    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1990d0fe_cc71_4c8b_9c4e_8e6237a314b3.slice/crio-bea0729caf2eb1b67b9026133e96428924a7cd67cb99b5126f892fbeb66db35b WatchSource:0}: Error finding container bea0729caf2eb1b67b9026133e96428924a7cd67cb99b5126f892fbeb66db35b: Status 404 returned error can't find the container with id bea0729caf2eb1b67b9026133e96428924a7cd67cb99b5126f892fbeb66db35b
Jul 06 19:35:14.732781 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.732745    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:14.732863 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:14.732800    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 06 19:35:15.513724 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:15.513693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h" event={"ID":"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3","Type":"ContainerStarted","Data":"fe37df6725e09d8c25a5b13da75764c1e9ab3247f385a97bc7b34368c0031651"}
Jul 06 19:35:15.514156 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:15.513744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h" event={"ID":"1990d0fe-cc71-4c8b-9c4e-8e6237a314b3","Type":"ContainerStarted","Data":"bea0729caf2eb1b67b9026133e96428924a7cd67cb99b5126f892fbeb66db35b"}
Jul 06 19:35:15.514156 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:15.513836    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:15.515342 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:15.515315    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-2kf7h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:35:15.515467 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:15.515380    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h" podUID="1990d0fe-cc71-4c8b-9c4e-8e6237a314b3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:35:15.544838 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:15.544788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h" podStartSLOduration=1.54477389 podStartE2EDuration="1.54477389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:15.542847391 +0000 UTC m=+604.861016578" watchObservedRunningTime="2026-07-06 19:35:15.54477389 +0000 UTC m=+604.862943056"
Jul 06 19:35:16.518828 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.518804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2kf7h"
Jul 06 19:35:16.604384 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.604352    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"]
Jul 06 19:35:16.604594 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.604570    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" podUID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" containerName="discovery" containerID="cri-o://7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9" gracePeriod=30
Jul 06 19:35:16.852075 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.852053    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:16.957167 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957134    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-token\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957181    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-dns-cert\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957230    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjfn2\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-kube-api-access-sjfn2\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957257    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-local-certs\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-kubeconfig\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957310 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957308    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-ca-configmap\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957572 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-cacerts\") pod \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\" (UID: \"f302c412-a3c1-4c46-bfb1-7ff2baa11de2\") "
Jul 06 19:35:16.957767 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.957736    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:16.960038 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.960005    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:16.960138 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.960123    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-kube-api-access-sjfn2" (OuterVolumeSpecName: "kube-api-access-sjfn2") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "kube-api-access-sjfn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:16.960178 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.960128    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-local-certs" (OuterVolumeSpecName: "local-certs") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:16.960178 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.960146    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-token" (OuterVolumeSpecName: "istio-token") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:16.960248 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.960216    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-cacerts" (OuterVolumeSpecName: "cacerts") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:16.960360 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:16.960342    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f302c412-a3c1-4c46-bfb1-7ff2baa11de2" (UID: "f302c412-a3c1-4c46-bfb1-7ff2baa11de2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:35:17.058741 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058706    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-token\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.058741 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058736    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-dns-cert\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.058943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058749    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjfn2\" (UniqueName: \"kubernetes.io/projected/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-kube-api-access-sjfn2\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.058943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058762    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-local-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.058943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058773    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-kubeconfig\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.058943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058783    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-istio-csr-ca-configmap\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.058943 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.058794    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f302c412-a3c1-4c46-bfb1-7ff2baa11de2-cacerts\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:35:17.523411 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.523330    2579 generic.go:356] "Generic (PLEG): container finished" podID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" containerID="7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9" exitCode=0
Jul 06 19:35:17.523411 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.523372    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"
Jul 06 19:35:17.523864 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.523422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" event={"ID":"f302c412-a3c1-4c46-bfb1-7ff2baa11de2","Type":"ContainerDied","Data":"7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9"}
Jul 06 19:35:17.523864 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.523469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr" event={"ID":"f302c412-a3c1-4c46-bfb1-7ff2baa11de2","Type":"ContainerDied","Data":"b6709aee48c421f334b4bc13d59acb1749503231b2779b3027c5e919e27813e2"}
Jul 06 19:35:17.524069 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.524056    2579 scope.go:117] "RemoveContainer" containerID="7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9"
Jul 06 19:35:17.532378 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.532362    2579 scope.go:117] "RemoveContainer" containerID="7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9"
Jul 06 19:35:17.532637 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:35:17.532617    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9\": container with ID starting with 7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9 not found: ID does not exist" containerID="7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9"
Jul 06 19:35:17.532697 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.532645    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9"} err="failed to get container status \"7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9\": rpc error: code = NotFound desc = could not find container \"7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9\": container with ID starting with 7c9e4c3c8dae02d2bd1e9d3d3cdffb1a580a772fca8b734b3c5f8636a5624cd9 not found: ID does not exist"
Jul 06 19:35:17.555248 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.555226    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"]
Jul 06 19:35:17.557689 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:17.557666    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2rwfr"]
Jul 06 19:35:19.251068 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:19.251035    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" path="/var/lib/kubelet/pods/f302c412-a3c1-4c46-bfb1-7ff2baa11de2/volumes"
Jul 06 19:35:21.496476 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:35:21.496445    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 19:36:05.494052 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.494016    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdrrg"]
Jul 06 19:36:05.496028 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.494357    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" containerName="discovery"
Jul 06 19:36:05.496028 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.494370    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" containerName="discovery"
Jul 06 19:36:05.496028 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.494424    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f302c412-a3c1-4c46-bfb1-7ff2baa11de2" containerName="discovery"
Jul 06 19:36:05.496510 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.496487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:05.499010 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.498951    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:36:05.499233 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.499214    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:36:05.499233 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.499225    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l7qvc\""
Jul 06 19:36:05.512627 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.512602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdrrg"]
Jul 06 19:36:05.570610 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.570559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4l7x\" (UniqueName: \"kubernetes.io/projected/42aed337-2629-4882-b546-b25f1e5c36e0-kube-api-access-p4l7x\") pod \"kuadrant-operator-catalog-mdrrg\" (UID: \"42aed337-2629-4882-b546-b25f1e5c36e0\") " pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:05.671000 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.670963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4l7x\" (UniqueName: \"kubernetes.io/projected/42aed337-2629-4882-b546-b25f1e5c36e0-kube-api-access-p4l7x\") pod \"kuadrant-operator-catalog-mdrrg\" (UID: \"42aed337-2629-4882-b546-b25f1e5c36e0\") " pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:05.679471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.679443    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4l7x\" (UniqueName: \"kubernetes.io/projected/42aed337-2629-4882-b546-b25f1e5c36e0-kube-api-access-p4l7x\") pod \"kuadrant-operator-catalog-mdrrg\" (UID: \"42aed337-2629-4882-b546-b25f1e5c36e0\") " pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:05.806129 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.806028    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:05.932578 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:05.932548    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdrrg"]
Jul 06 19:36:05.935187 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:05.935163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42aed337_2629_4882_b546_b25f1e5c36e0.slice/crio-dc48728d5ad223ccea5d1095bc91f1f7fd62fef1c7e673fc302877ca85073a3b WatchSource:0}: Error finding container dc48728d5ad223ccea5d1095bc91f1f7fd62fef1c7e673fc302877ca85073a3b: Status 404 returned error can't find the container with id dc48728d5ad223ccea5d1095bc91f1f7fd62fef1c7e673fc302877ca85073a3b
Jul 06 19:36:06.086959 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.086890    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdrrg"]
Jul 06 19:36:06.104069 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.104038    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqmpd"]
Jul 06 19:36:06.106868 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.106851    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:06.115479 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.115454    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqmpd"]
Jul 06 19:36:06.175471 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.175440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7kf9\" (UniqueName: \"kubernetes.io/projected/98fdd54a-7641-4f68-9930-c87d53abe370-kube-api-access-z7kf9\") pod \"kuadrant-operator-catalog-fqmpd\" (UID: \"98fdd54a-7641-4f68-9930-c87d53abe370\") " pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:06.276393 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.276362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7kf9\" (UniqueName: \"kubernetes.io/projected/98fdd54a-7641-4f68-9930-c87d53abe370-kube-api-access-z7kf9\") pod \"kuadrant-operator-catalog-fqmpd\" (UID: \"98fdd54a-7641-4f68-9930-c87d53abe370\") " pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:06.285138 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.285094    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7kf9\" (UniqueName: \"kubernetes.io/projected/98fdd54a-7641-4f68-9930-c87d53abe370-kube-api-access-z7kf9\") pod \"kuadrant-operator-catalog-fqmpd\" (UID: \"98fdd54a-7641-4f68-9930-c87d53abe370\") " pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:06.416762 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.416720    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:06.633944 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.633919    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqmpd"]
Jul 06 19:36:06.686413 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:06.686332    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98fdd54a_7641_4f68_9930_c87d53abe370.slice/crio-440cdbf5ca25f0dbcd79c9ed58bb2a3c37c2353d16f98a22b2a356a1c3006dc6 WatchSource:0}: Error finding container 440cdbf5ca25f0dbcd79c9ed58bb2a3c37c2353d16f98a22b2a356a1c3006dc6: Status 404 returned error can't find the container with id 440cdbf5ca25f0dbcd79c9ed58bb2a3c37c2353d16f98a22b2a356a1c3006dc6
Jul 06 19:36:06.744721 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.744685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg" event={"ID":"42aed337-2629-4882-b546-b25f1e5c36e0","Type":"ContainerStarted","Data":"dc48728d5ad223ccea5d1095bc91f1f7fd62fef1c7e673fc302877ca85073a3b"}
Jul 06 19:36:06.745953 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:06.745924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd" event={"ID":"98fdd54a-7641-4f68-9930-c87d53abe370","Type":"ContainerStarted","Data":"440cdbf5ca25f0dbcd79c9ed58bb2a3c37c2353d16f98a22b2a356a1c3006dc6"}
Jul 06 19:36:08.758088 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:08.758049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg" event={"ID":"42aed337-2629-4882-b546-b25f1e5c36e0","Type":"ContainerStarted","Data":"23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19"}
Jul 06 19:36:08.758088 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:08.758063    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg" podUID="42aed337-2629-4882-b546-b25f1e5c36e0" containerName="registry-server" containerID="cri-o://23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19" gracePeriod=2
Jul 06 19:36:08.759648 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:08.759622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd" event={"ID":"98fdd54a-7641-4f68-9930-c87d53abe370","Type":"ContainerStarted","Data":"f4c8ca618eae6b3e40226c8e2cdeab25bff26b07a731464e1bc5373070b49643"}
Jul 06 19:36:08.795207 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:08.795167    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg" podStartSLOduration=1.7402854620000001 podStartE2EDuration="3.795153046s" totalImagesPullingTime="2.054867584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:08.778262253 +0000 UTC m=+658.096431420" watchObservedRunningTime="2026-07-06 19:36:08.795153046 +0000 UTC m=+658.113322212"
Jul 06 19:36:08.796115 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:08.796073    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd" podStartSLOduration=1.4870033249999999 podStartE2EDuration="2.796065075s" totalImagesPullingTime="1.30906175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:08.793995489 +0000 UTC m=+658.112164654" watchObservedRunningTime="2026-07-06 19:36:08.796065075 +0000 UTC m=+658.114234451"
Jul 06 19:36:08.991487 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:08.991461    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:09.099724 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.099631    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4l7x\" (UniqueName: \"kubernetes.io/projected/42aed337-2629-4882-b546-b25f1e5c36e0-kube-api-access-p4l7x\") pod \"42aed337-2629-4882-b546-b25f1e5c36e0\" (UID: \"42aed337-2629-4882-b546-b25f1e5c36e0\") "
Jul 06 19:36:09.101723 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.101700    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42aed337-2629-4882-b546-b25f1e5c36e0-kube-api-access-p4l7x" (OuterVolumeSpecName: "kube-api-access-p4l7x") pod "42aed337-2629-4882-b546-b25f1e5c36e0" (UID: "42aed337-2629-4882-b546-b25f1e5c36e0"). InnerVolumeSpecName "kube-api-access-p4l7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:09.200260 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.200225    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4l7x\" (UniqueName: \"kubernetes.io/projected/42aed337-2629-4882-b546-b25f1e5c36e0-kube-api-access-p4l7x\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:09.765450 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.765421    2579 generic.go:356] "Generic (PLEG): container finished" podID="42aed337-2629-4882-b546-b25f1e5c36e0" containerID="23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19" exitCode=0
Jul 06 19:36:09.765874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.765477    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg"
Jul 06 19:36:09.765874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.765511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg" event={"ID":"42aed337-2629-4882-b546-b25f1e5c36e0","Type":"ContainerDied","Data":"23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19"}
Jul 06 19:36:09.765874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.765553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mdrrg" event={"ID":"42aed337-2629-4882-b546-b25f1e5c36e0","Type":"ContainerDied","Data":"dc48728d5ad223ccea5d1095bc91f1f7fd62fef1c7e673fc302877ca85073a3b"}
Jul 06 19:36:09.765874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.765575    2579 scope.go:117] "RemoveContainer" containerID="23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19"
Jul 06 19:36:09.773940 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.773921    2579 scope.go:117] "RemoveContainer" containerID="23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19"
Jul 06 19:36:09.774203 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:36:09.774185    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19\": container with ID starting with 23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19 not found: ID does not exist" containerID="23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19"
Jul 06 19:36:09.774272 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.774211    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19"} err="failed to get container status \"23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19\": rpc error: code = NotFound desc = could not find container \"23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19\": container with ID starting with 23b2b48615b68a26ec5db831415345b9cf949c39e304b5d9ad371688b9376e19 not found: ID does not exist"
Jul 06 19:36:09.782400 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.782379    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdrrg"]
Jul 06 19:36:09.788922 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:09.788899    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mdrrg"]
Jul 06 19:36:11.250282 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:11.250255    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42aed337-2629-4882-b546-b25f1e5c36e0" path="/var/lib/kubelet/pods/42aed337-2629-4882-b546-b25f1e5c36e0/volumes"
Jul 06 19:36:16.417329 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:16.417294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:16.417721 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:16.417352    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:16.439466 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:16.439442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:16.818308 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:16.818242    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fqmpd"
Jul 06 19:36:20.445006 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.444973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"]
Jul 06 19:36:20.445394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.445322    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42aed337-2629-4882-b546-b25f1e5c36e0" containerName="registry-server"
Jul 06 19:36:20.445394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.445335    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="42aed337-2629-4882-b546-b25f1e5c36e0" containerName="registry-server"
Jul 06 19:36:20.445394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.445395    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="42aed337-2629-4882-b546-b25f1e5c36e0" containerName="registry-server"
Jul 06 19:36:20.448399 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.448384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.450748 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.450730    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-229dl\""
Jul 06 19:36:20.458388 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.458368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"]
Jul 06 19:36:20.594676 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.594637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.594848 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.594700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.594848 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.594761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqz4\" (UniqueName: \"kubernetes.io/projected/546307ac-c6be-4a2d-8d37-97e89a1b214d-kube-api-access-dnqz4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.695981 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.695894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.695981 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.695953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.696181 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.696013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqz4\" (UniqueName: \"kubernetes.io/projected/546307ac-c6be-4a2d-8d37-97e89a1b214d-kube-api-access-dnqz4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.696377 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.696354    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.696413 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.696379    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.705319 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.705298    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqz4\" (UniqueName: \"kubernetes.io/projected/546307ac-c6be-4a2d-8d37-97e89a1b214d-kube-api-access-dnqz4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.757254 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.757229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:20.887895 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:20.887871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"]
Jul 06 19:36:20.889683 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:20.889657    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546307ac_c6be_4a2d_8d37_97e89a1b214d.slice/crio-836e3969340cffddf5797c5e1c97ceee9449c80bb9bda91f101fb85f7bfda1b6 WatchSource:0}: Error finding container 836e3969340cffddf5797c5e1c97ceee9449c80bb9bda91f101fb85f7bfda1b6: Status 404 returned error can't find the container with id 836e3969340cffddf5797c5e1c97ceee9449c80bb9bda91f101fb85f7bfda1b6
Jul 06 19:36:21.038757 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.038726    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"]
Jul 06 19:36:21.041064 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.041049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.052131 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.052084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"]
Jul 06 19:36:21.201612 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.201582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88s5j\" (UniqueName: \"kubernetes.io/projected/8c59fa2c-697d-402f-93d6-8eac38dd3849-kube-api-access-88s5j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.201747 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.201623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.201747 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.201715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.302774 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.302698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.302774 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.302746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88s5j\" (UniqueName: \"kubernetes.io/projected/8c59fa2c-697d-402f-93d6-8eac38dd3849-kube-api-access-88s5j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.302774 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.302765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.303144 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.303127    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.303144 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.303140    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.311858 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.311837    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88s5j\" (UniqueName: \"kubernetes.io/projected/8c59fa2c-697d-402f-93d6-8eac38dd3849-kube-api-access-88s5j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.349850 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.349829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:21.440265 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.440236    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"]
Jul 06 19:36:21.442968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.442948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.455446 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.455419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"]
Jul 06 19:36:21.484313 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.484290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"]
Jul 06 19:36:21.486390 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:21.486370    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c59fa2c_697d_402f_93d6_8eac38dd3849.slice/crio-fa7d8bcb421e3f5842786ebd295382141a1e89f2eeb89e1c4798f22cd8c6a1ed WatchSource:0}: Error finding container fa7d8bcb421e3f5842786ebd295382141a1e89f2eeb89e1c4798f22cd8c6a1ed: Status 404 returned error can't find the container with id fa7d8bcb421e3f5842786ebd295382141a1e89f2eeb89e1c4798f22cd8c6a1ed
Jul 06 19:36:21.605743 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.605709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjlzn\" (UniqueName: \"kubernetes.io/projected/91eb56bb-809e-4dd0-8eea-343bd1cedb91-kube-api-access-tjlzn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.605918 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.605761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.605918 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.605792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.707214 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.707177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjlzn\" (UniqueName: \"kubernetes.io/projected/91eb56bb-809e-4dd0-8eea-343bd1cedb91-kube-api-access-tjlzn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.707394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.707237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.707394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.707264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.707638 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.707617    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.707721 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.707626    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.716368 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.716347    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjlzn\" (UniqueName: \"kubernetes.io/projected/91eb56bb-809e-4dd0-8eea-343bd1cedb91-kube-api-access-tjlzn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.755292 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.755266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:21.824566 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.824535    2579 generic.go:356] "Generic (PLEG): container finished" podID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerID="15ade84cba3f10b4245b21b590d34b4732a1beff52d9ebf84cbf0bac33f1f059" exitCode=0
Jul 06 19:36:21.824723 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.824617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6" event={"ID":"546307ac-c6be-4a2d-8d37-97e89a1b214d","Type":"ContainerDied","Data":"15ade84cba3f10b4245b21b590d34b4732a1beff52d9ebf84cbf0bac33f1f059"}
Jul 06 19:36:21.824723 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.824674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6" event={"ID":"546307ac-c6be-4a2d-8d37-97e89a1b214d","Type":"ContainerStarted","Data":"836e3969340cffddf5797c5e1c97ceee9449c80bb9bda91f101fb85f7bfda1b6"}
Jul 06 19:36:21.826365 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.826346    2579 generic.go:356] "Generic (PLEG): container finished" podID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerID="edcdcaa30e56af83359ac3b201642b9004b4529cb2eaf2e49ead364919fa53b0" exitCode=0
Jul 06 19:36:21.826459 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.826434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5" event={"ID":"8c59fa2c-697d-402f-93d6-8eac38dd3849","Type":"ContainerDied","Data":"edcdcaa30e56af83359ac3b201642b9004b4529cb2eaf2e49ead364919fa53b0"}
Jul 06 19:36:21.826505 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.826492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5" event={"ID":"8c59fa2c-697d-402f-93d6-8eac38dd3849","Type":"ContainerStarted","Data":"fa7d8bcb421e3f5842786ebd295382141a1e89f2eeb89e1c4798f22cd8c6a1ed"}
Jul 06 19:36:21.841441 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.841421    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"]
Jul 06 19:36:21.844706 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.844689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:21.863121 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.860165    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"]
Jul 06 19:36:21.893014 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:21.892992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"]
Jul 06 19:36:21.894958 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:21.894927    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91eb56bb_809e_4dd0_8eea_343bd1cedb91.slice/crio-fd86d9190adb9a2246e31ef515dbb1a68eaa8400b965b66c6a02c7db3bd79d90 WatchSource:0}: Error finding container fd86d9190adb9a2246e31ef515dbb1a68eaa8400b965b66c6a02c7db3bd79d90: Status 404 returned error can't find the container with id fd86d9190adb9a2246e31ef515dbb1a68eaa8400b965b66c6a02c7db3bd79d90
Jul 06 19:36:22.011022 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.010992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vczd\" (UniqueName: \"kubernetes.io/projected/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-kube-api-access-2vczd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.011171 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.011038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.011171 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.011071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.112653 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.112573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vczd\" (UniqueName: \"kubernetes.io/projected/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-kube-api-access-2vczd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.112653 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.112612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.112849 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.112732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.112929 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.112915    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.113084 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.113064    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.122355 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.122329    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vczd\" (UniqueName: \"kubernetes.io/projected/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-kube-api-access-2vczd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.166442 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.166419    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:22.301255 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.301235    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"]
Jul 06 19:36:22.311302 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:22.311273    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae039ba_6b36_4878_b6d9_e34cccc5cbfa.slice/crio-e915c432a3c32e0ec59722ca329b81231e7961848d15c06193aa46f791ebe7c3 WatchSource:0}: Error finding container e915c432a3c32e0ec59722ca329b81231e7961848d15c06193aa46f791ebe7c3: Status 404 returned error can't find the container with id e915c432a3c32e0ec59722ca329b81231e7961848d15c06193aa46f791ebe7c3
Jul 06 19:36:22.832832 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.832795    2579 generic.go:356] "Generic (PLEG): container finished" podID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerID="2530bdf5558224122ea574a90730d3553a5e54d0a21fcd3094211aac621bce51" exitCode=0
Jul 06 19:36:22.833274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.832884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh" event={"ID":"bae039ba-6b36-4878-b6d9-e34cccc5cbfa","Type":"ContainerDied","Data":"2530bdf5558224122ea574a90730d3553a5e54d0a21fcd3094211aac621bce51"}
Jul 06 19:36:22.833274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.832936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh" event={"ID":"bae039ba-6b36-4878-b6d9-e34cccc5cbfa","Type":"ContainerStarted","Data":"e915c432a3c32e0ec59722ca329b81231e7961848d15c06193aa46f791ebe7c3"}
Jul 06 19:36:22.834534 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.834501    2579 generic.go:356] "Generic (PLEG): container finished" podID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerID="36e10c931d472fe624c5406d44e91cb662c4663db1d0ef67fce9af277d0945d8" exitCode=0
Jul 06 19:36:22.834631 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.834583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2" event={"ID":"91eb56bb-809e-4dd0-8eea-343bd1cedb91","Type":"ContainerDied","Data":"36e10c931d472fe624c5406d44e91cb662c4663db1d0ef67fce9af277d0945d8"}
Jul 06 19:36:22.834708 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.834634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2" event={"ID":"91eb56bb-809e-4dd0-8eea-343bd1cedb91","Type":"ContainerStarted","Data":"fd86d9190adb9a2246e31ef515dbb1a68eaa8400b965b66c6a02c7db3bd79d90"}
Jul 06 19:36:22.836694 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.836672    2579 generic.go:356] "Generic (PLEG): container finished" podID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerID="84d9cbf4abe5d652d05f887913991d2324217f53d4f9a0b7622069f0678def1c" exitCode=0
Jul 06 19:36:22.836832 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.836753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6" event={"ID":"546307ac-c6be-4a2d-8d37-97e89a1b214d","Type":"ContainerDied","Data":"84d9cbf4abe5d652d05f887913991d2324217f53d4f9a0b7622069f0678def1c"}
Jul 06 19:36:22.838759 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.838736    2579 generic.go:356] "Generic (PLEG): container finished" podID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerID="d0e92b9e79206a9b72ec7a3ff26325fcffddd06aa955449e36ddcc34b6893f44" exitCode=0
Jul 06 19:36:22.838832 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:22.838813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5" event={"ID":"8c59fa2c-697d-402f-93d6-8eac38dd3849","Type":"ContainerDied","Data":"d0e92b9e79206a9b72ec7a3ff26325fcffddd06aa955449e36ddcc34b6893f44"}
Jul 06 19:36:23.845940 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.845856    2579 generic.go:356] "Generic (PLEG): container finished" podID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerID="747b50fe4ca67eef8e1e2f156eb011da093ef3f2ed26b45dea3daabbccf60f3d" exitCode=0
Jul 06 19:36:23.846321 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.845937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6" event={"ID":"546307ac-c6be-4a2d-8d37-97e89a1b214d","Type":"ContainerDied","Data":"747b50fe4ca67eef8e1e2f156eb011da093ef3f2ed26b45dea3daabbccf60f3d"}
Jul 06 19:36:23.848082 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.848060    2579 generic.go:356] "Generic (PLEG): container finished" podID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerID="a031757b7dc516cc2065c5191089824da4577fb677f7b63018ee3b3982058a3d" exitCode=0
Jul 06 19:36:23.848214 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.848132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5" event={"ID":"8c59fa2c-697d-402f-93d6-8eac38dd3849","Type":"ContainerDied","Data":"a031757b7dc516cc2065c5191089824da4577fb677f7b63018ee3b3982058a3d"}
Jul 06 19:36:23.849917 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.849894    2579 generic.go:356] "Generic (PLEG): container finished" podID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerID="1e554b471a96b69ba8dc841ac4d8a8a9d9c0a6b61912f44f39fd12e2e4f6f7a8" exitCode=0
Jul 06 19:36:23.850030 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.849963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh" event={"ID":"bae039ba-6b36-4878-b6d9-e34cccc5cbfa","Type":"ContainerDied","Data":"1e554b471a96b69ba8dc841ac4d8a8a9d9c0a6b61912f44f39fd12e2e4f6f7a8"}
Jul 06 19:36:23.851847 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.851824    2579 generic.go:356] "Generic (PLEG): container finished" podID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerID="c07ad9391c63d244668684613d60f1a04755923df952ba585bc8477527902162" exitCode=0
Jul 06 19:36:23.851913 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:23.851877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2" event={"ID":"91eb56bb-809e-4dd0-8eea-343bd1cedb91","Type":"ContainerDied","Data":"c07ad9391c63d244668684613d60f1a04755923df952ba585bc8477527902162"}
Jul 06 19:36:24.859221 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:24.859183    2579 generic.go:356] "Generic (PLEG): container finished" podID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerID="b5cf0a3af97751aa006aeefc3fabc80e05dfb6a869132ca8d62d5229da2b70c8" exitCode=0
Jul 06 19:36:24.859623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:24.859233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh" event={"ID":"bae039ba-6b36-4878-b6d9-e34cccc5cbfa","Type":"ContainerDied","Data":"b5cf0a3af97751aa006aeefc3fabc80e05dfb6a869132ca8d62d5229da2b70c8"}
Jul 06 19:36:24.861186 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:24.861163    2579 generic.go:356] "Generic (PLEG): container finished" podID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerID="0dfd3b8d98bf16ab2cd4fa10f0f8aabe53d1ac73829bff72ba12712f72b56a08" exitCode=0
Jul 06 19:36:24.861320 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:24.861244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2" event={"ID":"91eb56bb-809e-4dd0-8eea-343bd1cedb91","Type":"ContainerDied","Data":"0dfd3b8d98bf16ab2cd4fa10f0f8aabe53d1ac73829bff72ba12712f72b56a08"}
Jul 06 19:36:24.987965 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:24.987933    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:25.023146 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.023095    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:25.138505 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.138479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-bundle\") pod \"8c59fa2c-697d-402f-93d6-8eac38dd3849\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") "
Jul 06 19:36:25.138690 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.138516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-util\") pod \"546307ac-c6be-4a2d-8d37-97e89a1b214d\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") "
Jul 06 19:36:25.138690 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.138540    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88s5j\" (UniqueName: \"kubernetes.io/projected/8c59fa2c-697d-402f-93d6-8eac38dd3849-kube-api-access-88s5j\") pod \"8c59fa2c-697d-402f-93d6-8eac38dd3849\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") "
Jul 06 19:36:25.138690 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.138571    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnqz4\" (UniqueName: \"kubernetes.io/projected/546307ac-c6be-4a2d-8d37-97e89a1b214d-kube-api-access-dnqz4\") pod \"546307ac-c6be-4a2d-8d37-97e89a1b214d\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") "
Jul 06 19:36:25.138690 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.138640    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-bundle\") pod \"546307ac-c6be-4a2d-8d37-97e89a1b214d\" (UID: \"546307ac-c6be-4a2d-8d37-97e89a1b214d\") "
Jul 06 19:36:25.138907 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.138761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-util\") pod \"8c59fa2c-697d-402f-93d6-8eac38dd3849\" (UID: \"8c59fa2c-697d-402f-93d6-8eac38dd3849\") "
Jul 06 19:36:25.139198 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.139171    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-bundle" (OuterVolumeSpecName: "bundle") pod "546307ac-c6be-4a2d-8d37-97e89a1b214d" (UID: "546307ac-c6be-4a2d-8d37-97e89a1b214d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:25.139375 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.139350    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-bundle" (OuterVolumeSpecName: "bundle") pod "8c59fa2c-697d-402f-93d6-8eac38dd3849" (UID: "8c59fa2c-697d-402f-93d6-8eac38dd3849"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:25.140742 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.140707    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546307ac-c6be-4a2d-8d37-97e89a1b214d-kube-api-access-dnqz4" (OuterVolumeSpecName: "kube-api-access-dnqz4") pod "546307ac-c6be-4a2d-8d37-97e89a1b214d" (UID: "546307ac-c6be-4a2d-8d37-97e89a1b214d"). InnerVolumeSpecName "kube-api-access-dnqz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:25.141008 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.140987    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59fa2c-697d-402f-93d6-8eac38dd3849-kube-api-access-88s5j" (OuterVolumeSpecName: "kube-api-access-88s5j") pod "8c59fa2c-697d-402f-93d6-8eac38dd3849" (UID: "8c59fa2c-697d-402f-93d6-8eac38dd3849"). InnerVolumeSpecName "kube-api-access-88s5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:25.144753 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.144726    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-util" (OuterVolumeSpecName: "util") pod "8c59fa2c-697d-402f-93d6-8eac38dd3849" (UID: "8c59fa2c-697d-402f-93d6-8eac38dd3849"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:25.144833 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.144816    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-util" (OuterVolumeSpecName: "util") pod "546307ac-c6be-4a2d-8d37-97e89a1b214d" (UID: "546307ac-c6be-4a2d-8d37-97e89a1b214d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:25.240172 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.240136    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:25.240172 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.240164    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:25.240172 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.240173    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c59fa2c-697d-402f-93d6-8eac38dd3849-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:25.240172 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.240180    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/546307ac-c6be-4a2d-8d37-97e89a1b214d-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:25.240431 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.240189    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88s5j\" (UniqueName: \"kubernetes.io/projected/8c59fa2c-697d-402f-93d6-8eac38dd3849-kube-api-access-88s5j\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:25.240431 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.240198    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnqz4\" (UniqueName: \"kubernetes.io/projected/546307ac-c6be-4a2d-8d37-97e89a1b214d-kube-api-access-dnqz4\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:25.867451 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.867422    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6"
Jul 06 19:36:25.867870 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.867421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6" event={"ID":"546307ac-c6be-4a2d-8d37-97e89a1b214d","Type":"ContainerDied","Data":"836e3969340cffddf5797c5e1c97ceee9449c80bb9bda91f101fb85f7bfda1b6"}
Jul 06 19:36:25.867870 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.867542    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="836e3969340cffddf5797c5e1c97ceee9449c80bb9bda91f101fb85f7bfda1b6"
Jul 06 19:36:25.869349 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.869321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5" event={"ID":"8c59fa2c-697d-402f-93d6-8eac38dd3849","Type":"ContainerDied","Data":"fa7d8bcb421e3f5842786ebd295382141a1e89f2eeb89e1c4798f22cd8c6a1ed"}
Jul 06 19:36:25.869530 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.869367    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa7d8bcb421e3f5842786ebd295382141a1e89f2eeb89e1c4798f22cd8c6a1ed"
Jul 06 19:36:25.870182 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:25.869747    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5"
Jul 06 19:36:26.034931 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.034910    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:26.043600 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.043580    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:26.148874 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.148841    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-bundle\") pod \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") "
Jul 06 19:36:26.149046 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.148884    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vczd\" (UniqueName: \"kubernetes.io/projected/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-kube-api-access-2vczd\") pod \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") "
Jul 06 19:36:26.149046 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.148933    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjlzn\" (UniqueName: \"kubernetes.io/projected/91eb56bb-809e-4dd0-8eea-343bd1cedb91-kube-api-access-tjlzn\") pod \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") "
Jul 06 19:36:26.149046 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.148952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-util\") pod \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") "
Jul 06 19:36:26.149046 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.148972    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-util\") pod \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\" (UID: \"91eb56bb-809e-4dd0-8eea-343bd1cedb91\") "
Jul 06 19:36:26.149046 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.148995    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-bundle\") pod \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\" (UID: \"bae039ba-6b36-4878-b6d9-e34cccc5cbfa\") "
Jul 06 19:36:26.149608 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.149582    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-bundle" (OuterVolumeSpecName: "bundle") pod "91eb56bb-809e-4dd0-8eea-343bd1cedb91" (UID: "91eb56bb-809e-4dd0-8eea-343bd1cedb91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:26.149755 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.149645    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-bundle" (OuterVolumeSpecName: "bundle") pod "bae039ba-6b36-4878-b6d9-e34cccc5cbfa" (UID: "bae039ba-6b36-4878-b6d9-e34cccc5cbfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:26.151093 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.151073    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91eb56bb-809e-4dd0-8eea-343bd1cedb91-kube-api-access-tjlzn" (OuterVolumeSpecName: "kube-api-access-tjlzn") pod "91eb56bb-809e-4dd0-8eea-343bd1cedb91" (UID: "91eb56bb-809e-4dd0-8eea-343bd1cedb91"). InnerVolumeSpecName "kube-api-access-tjlzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:26.151390 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.151373    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-kube-api-access-2vczd" (OuterVolumeSpecName: "kube-api-access-2vczd") pod "bae039ba-6b36-4878-b6d9-e34cccc5cbfa" (UID: "bae039ba-6b36-4878-b6d9-e34cccc5cbfa"). InnerVolumeSpecName "kube-api-access-2vczd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:36:26.155704 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.155673    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-util" (OuterVolumeSpecName: "util") pod "bae039ba-6b36-4878-b6d9-e34cccc5cbfa" (UID: "bae039ba-6b36-4878-b6d9-e34cccc5cbfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:26.157490 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.157466    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-util" (OuterVolumeSpecName: "util") pod "91eb56bb-809e-4dd0-8eea-343bd1cedb91" (UID: "91eb56bb-809e-4dd0-8eea-343bd1cedb91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:36:26.249811 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.249781    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjlzn\" (UniqueName: \"kubernetes.io/projected/91eb56bb-809e-4dd0-8eea-343bd1cedb91-kube-api-access-tjlzn\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:26.249811 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.249804    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:26.249811 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.249815    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-util\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:26.250013 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.249822    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:26.250013 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.249830    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91eb56bb-809e-4dd0-8eea-343bd1cedb91-bundle\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:26.250013 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.249837    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vczd\" (UniqueName: \"kubernetes.io/projected/bae039ba-6b36-4878-b6d9-e34cccc5cbfa-kube-api-access-2vczd\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:36:26.876013 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.875976    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh" event={"ID":"bae039ba-6b36-4878-b6d9-e34cccc5cbfa","Type":"ContainerDied","Data":"e915c432a3c32e0ec59722ca329b81231e7961848d15c06193aa46f791ebe7c3"}
Jul 06 19:36:26.876013 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.876010    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh"
Jul 06 19:36:26.876556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.876028    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e915c432a3c32e0ec59722ca329b81231e7961848d15c06193aa46f791ebe7c3"
Jul 06 19:36:26.877817 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.877797    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2"
Jul 06 19:36:26.877817 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.877808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2" event={"ID":"91eb56bb-809e-4dd0-8eea-343bd1cedb91","Type":"ContainerDied","Data":"fd86d9190adb9a2246e31ef515dbb1a68eaa8400b965b66c6a02c7db3bd79d90"}
Jul 06 19:36:26.878008 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:26.877838    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd86d9190adb9a2246e31ef515dbb1a68eaa8400b965b66c6a02c7db3bd79d90"
Jul 06 19:36:31.027842 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.027810    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"]
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028142    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="extract"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028155    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="extract"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028166    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="extract"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028172    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="extract"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028180    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="util"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028185    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="util"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028193    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="extract"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028198    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="extract"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028205    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="pull"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028210    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="pull"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028215    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="pull"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028219    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="pull"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028225    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="util"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028230    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="util"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028235    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="pull"
Jul 06 19:36:31.028234 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028240    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="pull"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028246    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="util"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028251    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="util"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028257    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="util"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028263    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="util"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028270    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="extract"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028276    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="extract"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028287    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="pull"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028292    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="pull"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028342    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c59fa2c-697d-402f-93d6-8eac38dd3849" containerName="extract"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028350    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="546307ac-c6be-4a2d-8d37-97e89a1b214d" containerName="extract"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028356    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae039ba-6b36-4878-b6d9-e34cccc5cbfa" containerName="extract"
Jul 06 19:36:31.028714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.028362    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="91eb56bb-809e-4dd0-8eea-343bd1cedb91" containerName="extract"
Jul 06 19:36:31.032311 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.032293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:31.035520 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.035503    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2htsj\""
Jul 06 19:36:31.042737 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.042715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"]
Jul 06 19:36:31.094458 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.094431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vlnt\" (UniqueName: \"kubernetes.io/projected/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff-kube-api-access-6vlnt\") pod \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" (UID: \"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:31.194803 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.194765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vlnt\" (UniqueName: \"kubernetes.io/projected/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff-kube-api-access-6vlnt\") pod \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" (UID: \"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:31.208487 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.208458    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vlnt\" (UniqueName: \"kubernetes.io/projected/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff-kube-api-access-6vlnt\") pod \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" (UID: \"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:31.343136 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.343038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:31.473669 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.473645    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"]
Jul 06 19:36:31.475427 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:31.475392    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6c06a7_bf60_4aaf_b776_cfddc5a552ff.slice/crio-5138e45b0e818092ac6474128d1506b9d2ad9aec34876e44dc778ee0cdf5975a WatchSource:0}: Error finding container 5138e45b0e818092ac6474128d1506b9d2ad9aec34876e44dc778ee0cdf5975a: Status 404 returned error can't find the container with id 5138e45b0e818092ac6474128d1506b9d2ad9aec34876e44dc778ee0cdf5975a
Jul 06 19:36:31.903871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:31.903832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9" event={"ID":"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff","Type":"ContainerStarted","Data":"5138e45b0e818092ac6474128d1506b9d2ad9aec34876e44dc778ee0cdf5975a"}
Jul 06 19:36:33.915378 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:33.915337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9" event={"ID":"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff","Type":"ContainerStarted","Data":"3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f"}
Jul 06 19:36:33.915772 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:33.915496    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:33.933094 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:33.933047    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9" podStartSLOduration=1.475123333 podStartE2EDuration="2.933004638s" totalImagesPullingTime="1.457881305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:33.931966336 +0000 UTC m=+683.250135514" watchObservedRunningTime="2026-07-06 19:36:33.933004638 +0000 UTC m=+683.251173803"
Jul 06 19:36:35.286124 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.286072    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"]
Jul 06 19:36:35.289223 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.289207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:36:35.291440 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.291418    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k7s2z\""
Jul 06 19:36:35.310121 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.310080    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"]
Jul 06 19:36:35.332288 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.332259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j944f\" (UniqueName: \"kubernetes.io/projected/816de7e1-87f7-460b-88c9-6829427561cf-kube-api-access-j944f\") pod \"authorino-operator-75cc8d5cb7-9gw7x\" (UID: \"816de7e1-87f7-460b-88c9-6829427561cf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:36:35.432692 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.432659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j944f\" (UniqueName: \"kubernetes.io/projected/816de7e1-87f7-460b-88c9-6829427561cf-kube-api-access-j944f\") pod \"authorino-operator-75cc8d5cb7-9gw7x\" (UID: \"816de7e1-87f7-460b-88c9-6829427561cf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:36:35.446927 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.446892    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j944f\" (UniqueName: \"kubernetes.io/projected/816de7e1-87f7-460b-88c9-6829427561cf-kube-api-access-j944f\") pod \"authorino-operator-75cc8d5cb7-9gw7x\" (UID: \"816de7e1-87f7-460b-88c9-6829427561cf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:36:35.599584 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.599502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:36:35.734327 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.734301    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"]
Jul 06 19:36:35.736266 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:36:35.736240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816de7e1_87f7_460b_88c9_6829427561cf.slice/crio-086bb2261ad5873fe8bbde9b962a697492cd3342939f0c56bddb80c1277f7b08 WatchSource:0}: Error finding container 086bb2261ad5873fe8bbde9b962a697492cd3342939f0c56bddb80c1277f7b08: Status 404 returned error can't find the container with id 086bb2261ad5873fe8bbde9b962a697492cd3342939f0c56bddb80c1277f7b08
Jul 06 19:36:35.925542 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:35.925509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x" event={"ID":"816de7e1-87f7-460b-88c9-6829427561cf","Type":"ContainerStarted","Data":"086bb2261ad5873fe8bbde9b962a697492cd3342939f0c56bddb80c1277f7b08"}
Jul 06 19:36:38.945519 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:38.945474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x" event={"ID":"816de7e1-87f7-460b-88c9-6829427561cf","Type":"ContainerStarted","Data":"03bfa4ced6f43495d9c9b700f1683252d3a85b09db1c99b7f6243a38d130ddf2"}
Jul 06 19:36:38.945873 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:38.945620    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:36:38.966302 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:38.966248    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x" podStartSLOduration=1.773509023 podStartE2EDuration="3.96622935s" totalImagesPullingTime="2.192720327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:38.96615233 +0000 UTC m=+688.284321518" watchObservedRunningTime="2026-07-06 19:36:38.96622935 +0000 UTC m=+688.284398513"
Jul 06 19:36:44.922813 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:44.922773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:36:49.953674 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:36:49.953645    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 19:37:02.126256 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.126212    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"]
Jul 06 19:37:02.126708 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.126470    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" containerName="manager" containerID="cri-o://3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f" gracePeriod=2
Jul 06 19:37:02.137091 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.137047    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"]
Jul 06 19:37:02.140924 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:02.140890    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8lzt9\": pods \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:02.156749 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.156722    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"]
Jul 06 19:37:02.157137 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.157089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" containerName="manager"
Jul 06 19:37:02.157137 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.157122    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" containerName="manager"
Jul 06 19:37:02.157274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.157235    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" containerName="manager"
Jul 06 19:37:02.160196 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.160177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:02.164088 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:02.164060    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" is forbidden: User \"system:node:ip-10-0-140-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-210.ec2.internal' and this object" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:02.169828 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.169805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"]
Jul 06 19:37:02.268696 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.268661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qtnt\" (UniqueName: \"kubernetes.io/projected/8c0e2394-1317-4758-8c50-e702df02dcca-kube-api-access-2qtnt\") pod \"limitador-operator-controller-manager-859d7b78bd-t9jpj\" (UID: \"8c0e2394-1317-4758-8c50-e702df02dcca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:02.368018 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.367997    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:02.370021 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:02.369995    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" is forbidden: User \"system:node:ip-10-0-140-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-210.ec2.internal' and this object" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:02.370133 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.370065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qtnt\" (UniqueName: \"kubernetes.io/projected/8c0e2394-1317-4758-8c50-e702df02dcca-kube-api-access-2qtnt\") pod \"limitador-operator-controller-manager-859d7b78bd-t9jpj\" (UID: \"8c0e2394-1317-4758-8c50-e702df02dcca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:02.379837 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.379796    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qtnt\" (UniqueName: \"kubernetes.io/projected/8c0e2394-1317-4758-8c50-e702df02dcca-kube-api-access-2qtnt\") pod \"limitador-operator-controller-manager-859d7b78bd-t9jpj\" (UID: \"8c0e2394-1317-4758-8c50-e702df02dcca\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:02.471329 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.471290    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vlnt\" (UniqueName: \"kubernetes.io/projected/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff-kube-api-access-6vlnt\") pod \"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff\" (UID: \"4b6c06a7-bf60-4aaf-b776-cfddc5a552ff\") "
Jul 06 19:37:02.473372 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.473347    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff-kube-api-access-6vlnt" (OuterVolumeSpecName: "kube-api-access-6vlnt") pod "4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" (UID: "4b6c06a7-bf60-4aaf-b776-cfddc5a552ff"). InnerVolumeSpecName "kube-api-access-6vlnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:02.511591 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.511560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:02.572657 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.572543    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vlnt\" (UniqueName: \"kubernetes.io/projected/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff-kube-api-access-6vlnt\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:37:02.644417 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:02.644391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"]
Jul 06 19:37:02.646525 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:37:02.646500    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c0e2394_1317_4758_8c50_e702df02dcca.slice/crio-405682b5ef617fe1de184ff06cfbac4e2ffeb2d0b29cd7a7d0c59a5f12f8ad0e WatchSource:0}: Error finding container 405682b5ef617fe1de184ff06cfbac4e2ffeb2d0b29cd7a7d0c59a5f12f8ad0e: Status 404 returned error can't find the container with id 405682b5ef617fe1de184ff06cfbac4e2ffeb2d0b29cd7a7d0c59a5f12f8ad0e
Jul 06 19:37:03.069729 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.069644    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" containerID="3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f" exitCode=0
Jul 06 19:37:03.069729 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.069690    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:03.069935 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.069743    2579 scope.go:117] "RemoveContainer" containerID="3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f"
Jul 06 19:37:03.071499 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.071471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj" event={"ID":"8c0e2394-1317-4758-8c50-e702df02dcca","Type":"ContainerStarted","Data":"86dca566e8af6488e28e32226ff44c810cae98b04cbc27665f24d397f4576475"}
Jul 06 19:37:03.071623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.071531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj" event={"ID":"8c0e2394-1317-4758-8c50-e702df02dcca","Type":"ContainerStarted","Data":"405682b5ef617fe1de184ff06cfbac4e2ffeb2d0b29cd7a7d0c59a5f12f8ad0e"}
Jul 06 19:37:03.071623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.071568    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:03.072212 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:03.072183    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" is forbidden: User \"system:node:ip-10-0-140-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-210.ec2.internal' and this object" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:03.074095 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:03.074069    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" is forbidden: User \"system:node:ip-10-0-140-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-210.ec2.internal' and this object" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:03.078888 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.078839    2579 scope.go:117] "RemoveContainer" containerID="3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f"
Jul 06 19:37:03.079159 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:03.079142    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f\": container with ID starting with 3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f not found: ID does not exist" containerID="3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f"
Jul 06 19:37:03.079198 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.079168    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f"} err="failed to get container status \"3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f\": rpc error: code = NotFound desc = could not find container \"3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f\": container with ID starting with 3242f313bab823962a2fe735fe3d325b0e8040669270dfd251eb62806508673f not found: ID does not exist"
Jul 06 19:37:03.093626 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.093587    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj" podStartSLOduration=1.093573495 podStartE2EDuration="1.093573495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:03.092479431 +0000 UTC m=+712.410648622" watchObservedRunningTime="2026-07-06 19:37:03.093573495 +0000 UTC m=+712.411742661"
Jul 06 19:37:03.094328 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:03.094305    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lzt9\" is forbidden: User \"system:node:ip-10-0-140-210.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-210.ec2.internal' and this object" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lzt9"
Jul 06 19:37:03.251119 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:03.251080    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6c06a7-bf60-4aaf-b776-cfddc5a552ff" path="/var/lib/kubelet/pods/4b6c06a7-bf60-4aaf-b776-cfddc5a552ff/volumes"
Jul 06 19:37:14.079992 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:14.079958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 19:37:44.665801 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.665771    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:37:44.668574 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.668554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.670913 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.670892    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:37:44.671014 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.670946    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-229dl\""
Jul 06 19:37:44.677940 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.677917    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:37:44.732543 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.732509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4763010b-968e-460b-a51f-a8a45a051936-config-file\") pod \"limitador-limitador-64c94fd64f-lb7zc\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.732716 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.732599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lv5\" (UniqueName: \"kubernetes.io/projected/4763010b-968e-460b-a51f-a8a45a051936-kube-api-access-t6lv5\") pod \"limitador-limitador-64c94fd64f-lb7zc\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.764425 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.764397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:37:44.833431 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.833402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4763010b-968e-460b-a51f-a8a45a051936-config-file\") pod \"limitador-limitador-64c94fd64f-lb7zc\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.833570 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.833443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lv5\" (UniqueName: \"kubernetes.io/projected/4763010b-968e-460b-a51f-a8a45a051936-kube-api-access-t6lv5\") pod \"limitador-limitador-64c94fd64f-lb7zc\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.833984 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.833966    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4763010b-968e-460b-a51f-a8a45a051936-config-file\") pod \"limitador-limitador-64c94fd64f-lb7zc\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.846723 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.846696    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lv5\" (UniqueName: \"kubernetes.io/projected/4763010b-968e-460b-a51f-a8a45a051936-kube-api-access-t6lv5\") pod \"limitador-limitador-64c94fd64f-lb7zc\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:44.979335 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:44.979250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:45.113692 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.113665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:37:45.116514 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:37:45.116491    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4763010b_968e_460b_a51f_a8a45a051936.slice/crio-603ca3d582868e8fc3ce226fb3ce8a7a792081d9be49603e8e52639f78b1330b WatchSource:0}: Error finding container 603ca3d582868e8fc3ce226fb3ce8a7a792081d9be49603e8e52639f78b1330b: Status 404 returned error can't find the container with id 603ca3d582868e8fc3ce226fb3ce8a7a792081d9be49603e8e52639f78b1330b
Jul 06 19:37:45.287974 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.287898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc" event={"ID":"4763010b-968e-460b-a51f-a8a45a051936","Type":"ContainerStarted","Data":"603ca3d582868e8fc3ce226fb3ce8a7a792081d9be49603e8e52639f78b1330b"}
Jul 06 19:37:45.551178 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.551087    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-tsz85"]
Jul 06 19:37:45.554318 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.554297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:45.556623 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.556603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gkrqv\""
Jul 06 19:37:45.562187 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.562167    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tsz85"]
Jul 06 19:37:45.638724 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.638693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsfg\" (UniqueName: \"kubernetes.io/projected/9b773d73-e280-4d64-b384-5e23be5d85ee-kube-api-access-hdsfg\") pod \"authorino-58cd955675-tsz85\" (UID: \"9b773d73-e280-4d64-b384-5e23be5d85ee\") " pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:45.739835 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.739484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsfg\" (UniqueName: \"kubernetes.io/projected/9b773d73-e280-4d64-b384-5e23be5d85ee-kube-api-access-hdsfg\") pod \"authorino-58cd955675-tsz85\" (UID: \"9b773d73-e280-4d64-b384-5e23be5d85ee\") " pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:45.754945 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.753865    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsfg\" (UniqueName: \"kubernetes.io/projected/9b773d73-e280-4d64-b384-5e23be5d85ee-kube-api-access-hdsfg\") pod \"authorino-58cd955675-tsz85\" (UID: \"9b773d73-e280-4d64-b384-5e23be5d85ee\") " pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:45.864781 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:45.864692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:46.032795 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:46.032756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tsz85"]
Jul 06 19:37:46.034979 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:37:46.034772    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b773d73_e280_4d64_b384_5e23be5d85ee.slice/crio-afcb646f648da958804ebed1eb0029f148fab5c13b5a5a9a109dadc39e7b6fed WatchSource:0}: Error finding container afcb646f648da958804ebed1eb0029f148fab5c13b5a5a9a109dadc39e7b6fed: Status 404 returned error can't find the container with id afcb646f648da958804ebed1eb0029f148fab5c13b5a5a9a109dadc39e7b6fed
Jul 06 19:37:46.295982 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:46.295933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tsz85" event={"ID":"9b773d73-e280-4d64-b384-5e23be5d85ee","Type":"ContainerStarted","Data":"afcb646f648da958804ebed1eb0029f148fab5c13b5a5a9a109dadc39e7b6fed"}
Jul 06 19:37:48.311873 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:48.311838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc" event={"ID":"4763010b-968e-460b-a51f-a8a45a051936","Type":"ContainerStarted","Data":"37795af2b1dd98a90870f1c9cbf3bc72f99724787ba3010c5b9e316de213850d"}
Jul 06 19:37:48.312331 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:48.311936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:37:48.333707 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:48.333648    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc" podStartSLOduration=1.61965837 podStartE2EDuration="4.333628898s" totalImagesPullingTime="2.713970528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:48.330249436 +0000 UTC m=+757.648418629" watchObservedRunningTime="2026-07-06 19:37:48.333628898 +0000 UTC m=+757.651798065"
Jul 06 19:37:50.324552 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:50.324470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tsz85" event={"ID":"9b773d73-e280-4d64-b384-5e23be5d85ee","Type":"ContainerStarted","Data":"f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f"}
Jul 06 19:37:50.340616 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:50.340568    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-tsz85" podStartSLOduration=1.4154317650000001 podStartE2EDuration="5.340552391s" totalImagesPullingTime="3.925120626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:50.340133238 +0000 UTC m=+759.658302405" watchObservedRunningTime="2026-07-06 19:37:50.340552391 +0000 UTC m=+759.658721594"
Jul 06 19:37:50.673971 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:50.673940    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tsz85"]
Jul 06 19:37:52.334525 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:52.334467    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-tsz85" podUID="9b773d73-e280-4d64-b384-5e23be5d85ee" containerName="authorino" containerID="cri-o://f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f" gracePeriod=30
Jul 06 19:37:52.589885 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:52.589823    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:52.704202 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:52.704172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdsfg\" (UniqueName: \"kubernetes.io/projected/9b773d73-e280-4d64-b384-5e23be5d85ee-kube-api-access-hdsfg\") pod \"9b773d73-e280-4d64-b384-5e23be5d85ee\" (UID: \"9b773d73-e280-4d64-b384-5e23be5d85ee\") "
Jul 06 19:37:52.706155 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:52.706134    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b773d73-e280-4d64-b384-5e23be5d85ee-kube-api-access-hdsfg" (OuterVolumeSpecName: "kube-api-access-hdsfg") pod "9b773d73-e280-4d64-b384-5e23be5d85ee" (UID: "9b773d73-e280-4d64-b384-5e23be5d85ee"). InnerVolumeSpecName "kube-api-access-hdsfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:52.805396 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:52.805363    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdsfg\" (UniqueName: \"kubernetes.io/projected/9b773d73-e280-4d64-b384-5e23be5d85ee-kube-api-access-hdsfg\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:37:53.340860 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.340827    2579 generic.go:356] "Generic (PLEG): container finished" podID="9b773d73-e280-4d64-b384-5e23be5d85ee" containerID="f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f" exitCode=0
Jul 06 19:37:53.341292 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.340874    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tsz85"
Jul 06 19:37:53.341292 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.340923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tsz85" event={"ID":"9b773d73-e280-4d64-b384-5e23be5d85ee","Type":"ContainerDied","Data":"f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f"}
Jul 06 19:37:53.341292 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.340964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tsz85" event={"ID":"9b773d73-e280-4d64-b384-5e23be5d85ee","Type":"ContainerDied","Data":"afcb646f648da958804ebed1eb0029f148fab5c13b5a5a9a109dadc39e7b6fed"}
Jul 06 19:37:53.341292 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.340980    2579 scope.go:117] "RemoveContainer" containerID="f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f"
Jul 06 19:37:53.349767 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.349746    2579 scope.go:117] "RemoveContainer" containerID="f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f"
Jul 06 19:37:53.350032 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:37:53.350013    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f\": container with ID starting with f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f not found: ID does not exist" containerID="f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f"
Jul 06 19:37:53.350074 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.350039    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f"} err="failed to get container status \"f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f\": rpc error: code = NotFound desc = could not find container \"f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f\": container with ID starting with f92024f31f2285b821def60b939a4da7d3f016ac09cd7e9eb0282c9bba01c58f not found: ID does not exist"
Jul 06 19:37:53.358377 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.358352    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tsz85"]
Jul 06 19:37:53.363386 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:53.363366    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-tsz85"]
Jul 06 19:37:55.251153 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:55.251124    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b773d73-e280-4d64-b384-5e23be5d85ee" path="/var/lib/kubelet/pods/9b773d73-e280-4d64-b384-5e23be5d85ee/volumes"
Jul 06 19:37:59.319216 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:37:59.319188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:38:00.026263 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:00.026231    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:38:00.026446 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:00.026421    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc" podUID="4763010b-968e-460b-a51f-a8a45a051936" containerName="limitador" containerID="cri-o://37795af2b1dd98a90870f1c9cbf3bc72f99724787ba3010c5b9e316de213850d" gracePeriod=30
Jul 06 19:38:00.376026 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:00.375998    2579 generic.go:356] "Generic (PLEG): container finished" podID="4763010b-968e-460b-a51f-a8a45a051936" containerID="37795af2b1dd98a90870f1c9cbf3bc72f99724787ba3010c5b9e316de213850d" exitCode=0
Jul 06 19:38:00.376408 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:00.376069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc" event={"ID":"4763010b-968e-460b-a51f-a8a45a051936","Type":"ContainerDied","Data":"37795af2b1dd98a90870f1c9cbf3bc72f99724787ba3010c5b9e316de213850d"}
Jul 06 19:38:00.971245 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:00.971225    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:38:01.073921 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.073884    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6lv5\" (UniqueName: \"kubernetes.io/projected/4763010b-968e-460b-a51f-a8a45a051936-kube-api-access-t6lv5\") pod \"4763010b-968e-460b-a51f-a8a45a051936\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") "
Jul 06 19:38:01.074099 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.073978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4763010b-968e-460b-a51f-a8a45a051936-config-file\") pod \"4763010b-968e-460b-a51f-a8a45a051936\" (UID: \"4763010b-968e-460b-a51f-a8a45a051936\") "
Jul 06 19:38:01.074381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.074356    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4763010b-968e-460b-a51f-a8a45a051936-config-file" (OuterVolumeSpecName: "config-file") pod "4763010b-968e-460b-a51f-a8a45a051936" (UID: "4763010b-968e-460b-a51f-a8a45a051936"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:01.076055 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.076032    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4763010b-968e-460b-a51f-a8a45a051936-kube-api-access-t6lv5" (OuterVolumeSpecName: "kube-api-access-t6lv5") pod "4763010b-968e-460b-a51f-a8a45a051936" (UID: "4763010b-968e-460b-a51f-a8a45a051936"). InnerVolumeSpecName "kube-api-access-t6lv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:01.175314 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.175278    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6lv5\" (UniqueName: \"kubernetes.io/projected/4763010b-968e-460b-a51f-a8a45a051936-kube-api-access-t6lv5\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:38:01.175314 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.175310    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4763010b-968e-460b-a51f-a8a45a051936-config-file\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:38:01.382628 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.382600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc" event={"ID":"4763010b-968e-460b-a51f-a8a45a051936","Type":"ContainerDied","Data":"603ca3d582868e8fc3ce226fb3ce8a7a792081d9be49603e8e52639f78b1330b"}
Jul 06 19:38:01.382628 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.382627    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"
Jul 06 19:38:01.383145 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.382658    2579 scope.go:117] "RemoveContainer" containerID="37795af2b1dd98a90870f1c9cbf3bc72f99724787ba3010c5b9e316de213850d"
Jul 06 19:38:01.412137 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.409465    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:38:01.416871 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:01.416837    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lb7zc"]
Jul 06 19:38:03.251293 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:03.251261    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4763010b-968e-460b-a51f-a8a45a051936" path="/var/lib/kubelet/pods/4763010b-968e-460b-a51f-a8a45a051936/volumes"
Jul 06 19:38:04.720311 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720275    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-x4bc6"]
Jul 06 19:38:04.720809 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720719    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4763010b-968e-460b-a51f-a8a45a051936" containerName="limitador"
Jul 06 19:38:04.720809 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720739    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4763010b-968e-460b-a51f-a8a45a051936" containerName="limitador"
Jul 06 19:38:04.720809 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720750    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b773d73-e280-4d64-b384-5e23be5d85ee" containerName="authorino"
Jul 06 19:38:04.720809 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720757    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b773d73-e280-4d64-b384-5e23be5d85ee" containerName="authorino"
Jul 06 19:38:04.721028 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720854    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b773d73-e280-4d64-b384-5e23be5d85ee" containerName="authorino"
Jul 06 19:38:04.721028 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.720864    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4763010b-968e-460b-a51f-a8a45a051936" containerName="limitador"
Jul 06 19:38:04.724965 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.724942    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:04.727385 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.727363    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 19:38:04.727385 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.727383    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kjdhc\""
Jul 06 19:38:04.734004 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.733980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-x4bc6"]
Jul 06 19:38:04.809702 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.809666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4dc186e7-740b-460f-bc7b-c0dc8393a23e-data\") pod \"postgres-69fb4594cf-x4bc6\" (UID: \"4dc186e7-740b-460f-bc7b-c0dc8393a23e\") " pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:04.809866 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.809723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwwzz\" (UniqueName: \"kubernetes.io/projected/4dc186e7-740b-460f-bc7b-c0dc8393a23e-kube-api-access-zwwzz\") pod \"postgres-69fb4594cf-x4bc6\" (UID: \"4dc186e7-740b-460f-bc7b-c0dc8393a23e\") " pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:04.911009 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.910970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4dc186e7-740b-460f-bc7b-c0dc8393a23e-data\") pod \"postgres-69fb4594cf-x4bc6\" (UID: \"4dc186e7-740b-460f-bc7b-c0dc8393a23e\") " pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:04.911209 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.911026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwwzz\" (UniqueName: \"kubernetes.io/projected/4dc186e7-740b-460f-bc7b-c0dc8393a23e-kube-api-access-zwwzz\") pod \"postgres-69fb4594cf-x4bc6\" (UID: \"4dc186e7-740b-460f-bc7b-c0dc8393a23e\") " pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:04.911370 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.911353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4dc186e7-740b-460f-bc7b-c0dc8393a23e-data\") pod \"postgres-69fb4594cf-x4bc6\" (UID: \"4dc186e7-740b-460f-bc7b-c0dc8393a23e\") " pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:04.919409 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:04.919375    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwwzz\" (UniqueName: \"kubernetes.io/projected/4dc186e7-740b-460f-bc7b-c0dc8393a23e-kube-api-access-zwwzz\") pod \"postgres-69fb4594cf-x4bc6\" (UID: \"4dc186e7-740b-460f-bc7b-c0dc8393a23e\") " pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:05.036473 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:05.036390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:05.167802 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:05.167774    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-x4bc6"]
Jul 06 19:38:05.169436 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:38:05.169406    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc186e7_740b_460f_bc7b_c0dc8393a23e.slice/crio-3ab435702c510c0891d657153b60bc5ac52909b3a6926bbfd9bb4415f6d05a2b WatchSource:0}: Error finding container 3ab435702c510c0891d657153b60bc5ac52909b3a6926bbfd9bb4415f6d05a2b: Status 404 returned error can't find the container with id 3ab435702c510c0891d657153b60bc5ac52909b3a6926bbfd9bb4415f6d05a2b
Jul 06 19:38:05.404541 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:05.404505    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-x4bc6" event={"ID":"4dc186e7-740b-460f-bc7b-c0dc8393a23e","Type":"ContainerStarted","Data":"3ab435702c510c0891d657153b60bc5ac52909b3a6926bbfd9bb4415f6d05a2b"}
Jul 06 19:38:10.436375 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:10.436333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-x4bc6" event={"ID":"4dc186e7-740b-460f-bc7b-c0dc8393a23e","Type":"ContainerStarted","Data":"5d645610aea3e6ec90f74fa6e573e1b11c09f79163639cf3ade971f6aa97bf7a"}
Jul 06 19:38:10.436760 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:10.436413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:10.456804 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:10.456755    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-x4bc6" podStartSLOduration=1.7751992460000001 podStartE2EDuration="6.456739982s" totalImagesPullingTime="4.681540736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:10.454995763 +0000 UTC m=+779.773164949" watchObservedRunningTime="2026-07-06 19:38:10.456739982 +0000 UTC m=+779.774909148"
Jul 06 19:38:16.470483 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:16.470456    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-x4bc6"
Jul 06 19:38:17.360412 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.360374    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fd9d9f5cc-fs2kz"]
Jul 06 19:38:17.366457 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.366428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.368763 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.368741    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 19:38:17.368887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.368812    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gkrqv\""
Jul 06 19:38:17.372599 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.372575    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd9d9f5cc-fs2kz"]
Jul 06 19:38:17.522162 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.522129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-tls-cert\") pod \"authorino-fd9d9f5cc-fs2kz\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") " pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.522528 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.522183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vs2\" (UniqueName: \"kubernetes.io/projected/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-kube-api-access-f7vs2\") pod \"authorino-fd9d9f5cc-fs2kz\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") " pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.622898 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.622824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-tls-cert\") pod \"authorino-fd9d9f5cc-fs2kz\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") " pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.622898 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.622879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vs2\" (UniqueName: \"kubernetes.io/projected/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-kube-api-access-f7vs2\") pod \"authorino-fd9d9f5cc-fs2kz\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") " pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.625254 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.625228    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-tls-cert\") pod \"authorino-fd9d9f5cc-fs2kz\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") " pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.631928 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.631907    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vs2\" (UniqueName: \"kubernetes.io/projected/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-kube-api-access-f7vs2\") pod \"authorino-fd9d9f5cc-fs2kz\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") " pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.676355 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.676323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:38:17.802428 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:17.802407    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fd9d9f5cc-fs2kz"]
Jul 06 19:38:17.804096 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:38:17.804068    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4f85b88_ff3f_441d_863e_5ba2e7dfef09.slice/crio-fff73ecff31c68f4411991f5b1352e45279524be5b0f0e44617e115ba90ea2da WatchSource:0}: Error finding container fff73ecff31c68f4411991f5b1352e45279524be5b0f0e44617e115ba90ea2da: Status 404 returned error can't find the container with id fff73ecff31c68f4411991f5b1352e45279524be5b0f0e44617e115ba90ea2da
Jul 06 19:38:18.475572 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:18.475538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz" event={"ID":"b4f85b88-ff3f-441d-863e-5ba2e7dfef09","Type":"ContainerStarted","Data":"b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5"}
Jul 06 19:38:18.475736 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:18.475579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz" event={"ID":"b4f85b88-ff3f-441d-863e-5ba2e7dfef09","Type":"ContainerStarted","Data":"fff73ecff31c68f4411991f5b1352e45279524be5b0f0e44617e115ba90ea2da"}
Jul 06 19:38:18.494393 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:18.494343    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz" podStartSLOduration=1.016634686 podStartE2EDuration="1.494326897s" totalImagesPullingTime="477.692211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:18.491970747 +0000 UTC m=+787.810139916" watchObservedRunningTime="2026-07-06 19:38:18.494326897 +0000 UTC m=+787.812496067"
Jul 06 19:38:22.802008 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.801975    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f5774c4f4-fq5vf"]
Jul 06 19:38:22.878339 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.878306    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5774c4f4-fq5vf"]
Jul 06 19:38:22.878492 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.878419    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:22.880968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.880938    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:38:22.880968 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.880942    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:38:22.881169 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.880944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8fhhp\""
Jul 06 19:38:22.960769 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.960733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-webhook-cert\") pod \"maas-controller-5f5774c4f4-fq5vf\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") " pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:22.960927 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.960788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cglq6\" (UniqueName: \"kubernetes.io/projected/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-kube-api-access-cglq6\") pod \"maas-controller-5f5774c4f4-fq5vf\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") " pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:22.985986 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:22.985954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-689c7557c-rsgcl"]
Jul 06 19:38:23.015581 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.015555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-689c7557c-rsgcl"]
Jul 06 19:38:23.015733 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.015645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.062139 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.062035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcb4t\" (UniqueName: \"kubernetes.io/projected/527b2d58-6f15-4e24-b7fd-4c752f00fd19-kube-api-access-wcb4t\") pod \"maas-controller-689c7557c-rsgcl\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") " pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.062139 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.062077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglq6\" (UniqueName: \"kubernetes.io/projected/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-kube-api-access-cglq6\") pod \"maas-controller-5f5774c4f4-fq5vf\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") " pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:23.062320 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.062214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/527b2d58-6f15-4e24-b7fd-4c752f00fd19-webhook-cert\") pod \"maas-controller-689c7557c-rsgcl\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") " pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.062320 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.062253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-webhook-cert\") pod \"maas-controller-5f5774c4f4-fq5vf\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") " pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:23.064627 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.064608    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-webhook-cert\") pod \"maas-controller-5f5774c4f4-fq5vf\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") " pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:23.070352 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.070331    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cglq6\" (UniqueName: \"kubernetes.io/projected/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-kube-api-access-cglq6\") pod \"maas-controller-5f5774c4f4-fq5vf\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") " pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:23.162864 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.162819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcb4t\" (UniqueName: \"kubernetes.io/projected/527b2d58-6f15-4e24-b7fd-4c752f00fd19-kube-api-access-wcb4t\") pod \"maas-controller-689c7557c-rsgcl\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") " pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.163029 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.162930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/527b2d58-6f15-4e24-b7fd-4c752f00fd19-webhook-cert\") pod \"maas-controller-689c7557c-rsgcl\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") " pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.165411 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.165383    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/527b2d58-6f15-4e24-b7fd-4c752f00fd19-webhook-cert\") pod \"maas-controller-689c7557c-rsgcl\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") " pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.171373 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.171339    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcb4t\" (UniqueName: \"kubernetes.io/projected/527b2d58-6f15-4e24-b7fd-4c752f00fd19-kube-api-access-wcb4t\") pod \"maas-controller-689c7557c-rsgcl\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") " pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.189185 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.189146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:23.326854 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.326779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:23.354333 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.354310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f5774c4f4-fq5vf"]
Jul 06 19:38:23.355445 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:38:23.355421    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d8b49c_ecf4_4511_b0bc_e44e4328a67c.slice/crio-c836f8f90cb4bc8077d4f6c76ca0ce351683fab27d8cbea4c51017f2ed7992a2 WatchSource:0}: Error finding container c836f8f90cb4bc8077d4f6c76ca0ce351683fab27d8cbea4c51017f2ed7992a2: Status 404 returned error can't find the container with id c836f8f90cb4bc8077d4f6c76ca0ce351683fab27d8cbea4c51017f2ed7992a2
Jul 06 19:38:23.493689 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.493659    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-689c7557c-rsgcl"]
Jul 06 19:38:23.495118 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:38:23.495074    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527b2d58_6f15_4e24_b7fd_4c752f00fd19.slice/crio-acbb64f52b6d43c1ebfe82b83c6f67fbd1019b133907d2cb1a76724b4c8226d3 WatchSource:0}: Error finding container acbb64f52b6d43c1ebfe82b83c6f67fbd1019b133907d2cb1a76724b4c8226d3: Status 404 returned error can't find the container with id acbb64f52b6d43c1ebfe82b83c6f67fbd1019b133907d2cb1a76724b4c8226d3
Jul 06 19:38:23.501620 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.501592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf" event={"ID":"40d8b49c-ecf4-4511-b0bc-e44e4328a67c","Type":"ContainerStarted","Data":"c836f8f90cb4bc8077d4f6c76ca0ce351683fab27d8cbea4c51017f2ed7992a2"}
Jul 06 19:38:23.502700 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:23.502674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-rsgcl" event={"ID":"527b2d58-6f15-4e24-b7fd-4c752f00fd19","Type":"ContainerStarted","Data":"acbb64f52b6d43c1ebfe82b83c6f67fbd1019b133907d2cb1a76724b4c8226d3"}
Jul 06 19:38:26.526190 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:26.526140    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-rsgcl" event={"ID":"527b2d58-6f15-4e24-b7fd-4c752f00fd19","Type":"ContainerStarted","Data":"ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98"}
Jul 06 19:38:26.526683 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:26.526338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:26.527770 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:26.527748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf" event={"ID":"40d8b49c-ecf4-4511-b0bc-e44e4328a67c","Type":"ContainerStarted","Data":"7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1"}
Jul 06 19:38:26.527892 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:26.527800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:26.547615 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:26.547571    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-689c7557c-rsgcl" podStartSLOduration=1.89222272 podStartE2EDuration="4.547559817s" totalImagesPullingTime="2.655337097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:26.545396093 +0000 UTC m=+795.863565280" watchObservedRunningTime="2026-07-06 19:38:26.547559817 +0000 UTC m=+795.865728962"
Jul 06 19:38:26.563246 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:26.563206    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf" podStartSLOduration=1.775827662 podStartE2EDuration="4.563193867s" totalImagesPullingTime="2.787366205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:26.561509577 +0000 UTC m=+795.879678793" watchObservedRunningTime="2026-07-06 19:38:26.563193867 +0000 UTC m=+795.881363068"
Jul 06 19:38:37.541556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.541475    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:38:37.541928 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.541769    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:37.630395 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.630365    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5774c4f4-fq5vf"]
Jul 06 19:38:37.630594 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.630562    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf" podUID="40d8b49c-ecf4-4511-b0bc-e44e4328a67c" containerName="manager" containerID="cri-o://7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1" gracePeriod=30
Jul 06 19:38:37.870441 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.870419    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:37.996090 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.996059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-webhook-cert\") pod \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") "
Jul 06 19:38:37.996270 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.996152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cglq6\" (UniqueName: \"kubernetes.io/projected/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-kube-api-access-cglq6\") pod \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\" (UID: \"40d8b49c-ecf4-4511-b0bc-e44e4328a67c\") "
Jul 06 19:38:37.998390 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.998358    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-kube-api-access-cglq6" (OuterVolumeSpecName: "kube-api-access-cglq6") pod "40d8b49c-ecf4-4511-b0bc-e44e4328a67c" (UID: "40d8b49c-ecf4-4511-b0bc-e44e4328a67c"). InnerVolumeSpecName "kube-api-access-cglq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:37.998498 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:37.998429    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "40d8b49c-ecf4-4511-b0bc-e44e4328a67c" (UID: "40d8b49c-ecf4-4511-b0bc-e44e4328a67c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:38:38.097284 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.097213    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-webhook-cert\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:38:38.097284 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.097238    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cglq6\" (UniqueName: \"kubernetes.io/projected/40d8b49c-ecf4-4511-b0bc-e44e4328a67c-kube-api-access-cglq6\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:38:38.593559 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.593524    2579 generic.go:356] "Generic (PLEG): container finished" podID="40d8b49c-ecf4-4511-b0bc-e44e4328a67c" containerID="7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1" exitCode=0
Jul 06 19:38:38.594035 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.593572    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf"
Jul 06 19:38:38.594035 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.593603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf" event={"ID":"40d8b49c-ecf4-4511-b0bc-e44e4328a67c","Type":"ContainerDied","Data":"7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1"}
Jul 06 19:38:38.594035 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.593653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f5774c4f4-fq5vf" event={"ID":"40d8b49c-ecf4-4511-b0bc-e44e4328a67c","Type":"ContainerDied","Data":"c836f8f90cb4bc8077d4f6c76ca0ce351683fab27d8cbea4c51017f2ed7992a2"}
Jul 06 19:38:38.594035 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.593675    2579 scope.go:117] "RemoveContainer" containerID="7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1"
Jul 06 19:38:38.602654 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.602639    2579 scope.go:117] "RemoveContainer" containerID="7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1"
Jul 06 19:38:38.602897 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:38:38.602876    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1\": container with ID starting with 7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1 not found: ID does not exist" containerID="7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1"
Jul 06 19:38:38.602944 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.602909    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1"} err="failed to get container status \"7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1\": rpc error: code = NotFound desc = could not find container \"7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1\": container with ID starting with 7ed6f96a7b4cb802a8d71298ef537acea05f90b501bb0a7aed69a0e42bdfc6f1 not found: ID does not exist"
Jul 06 19:38:38.616607 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.616587    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f5774c4f4-fq5vf"]
Jul 06 19:38:38.618569 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:38.618552    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f5774c4f4-fq5vf"]
Jul 06 19:38:39.250996 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:39.250965    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40d8b49c-ecf4-4511-b0bc-e44e4328a67c" path="/var/lib/kubelet/pods/40d8b49c-ecf4-4511-b0bc-e44e4328a67c/volumes"
Jul 06 19:38:59.081568 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.081533    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-96tzh"]
Jul 06 19:38:59.081966 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.081897    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d8b49c-ecf4-4511-b0bc-e44e4328a67c" containerName="manager"
Jul 06 19:38:59.081966 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.081910    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d8b49c-ecf4-4511-b0bc-e44e4328a67c" containerName="manager"
Jul 06 19:38:59.082040 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.081968    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d8b49c-ecf4-4511-b0bc-e44e4328a67c" containerName="manager"
Jul 06 19:38:59.087989 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.087972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.092274 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.092255    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 19:38:59.105045 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.105024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-96tzh"]
Jul 06 19:38:59.175380 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.175351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6tj\" (UniqueName: \"kubernetes.io/projected/8e500e1e-4165-4f22-85b5-ed539296a390-kube-api-access-nm6tj\") pod \"payload-processing-58f86c7798-96tzh\" (UID: \"8e500e1e-4165-4f22-85b5-ed539296a390\") " pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.175553 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.175417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e500e1e-4165-4f22-85b5-ed539296a390-plugins-config-volume\") pod \"payload-processing-58f86c7798-96tzh\" (UID: \"8e500e1e-4165-4f22-85b5-ed539296a390\") " pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.275844 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.275808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e500e1e-4165-4f22-85b5-ed539296a390-plugins-config-volume\") pod \"payload-processing-58f86c7798-96tzh\" (UID: \"8e500e1e-4165-4f22-85b5-ed539296a390\") " pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.276024 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.275864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6tj\" (UniqueName: \"kubernetes.io/projected/8e500e1e-4165-4f22-85b5-ed539296a390-kube-api-access-nm6tj\") pod \"payload-processing-58f86c7798-96tzh\" (UID: \"8e500e1e-4165-4f22-85b5-ed539296a390\") " pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.276954 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.276924    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e500e1e-4165-4f22-85b5-ed539296a390-plugins-config-volume\") pod \"payload-processing-58f86c7798-96tzh\" (UID: \"8e500e1e-4165-4f22-85b5-ed539296a390\") " pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.287952 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.287920    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6tj\" (UniqueName: \"kubernetes.io/projected/8e500e1e-4165-4f22-85b5-ed539296a390-kube-api-access-nm6tj\") pod \"payload-processing-58f86c7798-96tzh\" (UID: \"8e500e1e-4165-4f22-85b5-ed539296a390\") " pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.397785 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.397751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:38:59.529299 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.529256    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-96tzh"]
Jul 06 19:38:59.530931 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:38:59.530906    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e500e1e_4165_4f22_85b5_ed539296a390.slice/crio-bcb12febc5365a43cbb75f7a28e6653a4caab6812cb8dad447f748c79f7b36bc WatchSource:0}: Error finding container bcb12febc5365a43cbb75f7a28e6653a4caab6812cb8dad447f748c79f7b36bc: Status 404 returned error can't find the container with id bcb12febc5365a43cbb75f7a28e6653a4caab6812cb8dad447f748c79f7b36bc
Jul 06 19:38:59.532805 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.532787    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:38:59.703376 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:38:59.703292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-96tzh" event={"ID":"8e500e1e-4165-4f22-85b5-ed539296a390","Type":"ContainerStarted","Data":"bcb12febc5365a43cbb75f7a28e6653a4caab6812cb8dad447f748c79f7b36bc"}
Jul 06 19:39:01.715257 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:01.715227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-96tzh" event={"ID":"8e500e1e-4165-4f22-85b5-ed539296a390","Type":"ContainerStarted","Data":"cdbab94b775c19c6ca05cd342f840c334a451d7707470751b28ba1965e24b430"}
Jul 06 19:39:01.715659 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:01.715290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:39:01.739331 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:01.739272    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-96tzh" podStartSLOduration=1.435041305 podStartE2EDuration="2.739256988s" totalImagesPullingTime="1.304215683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:01.736821719 +0000 UTC m=+831.054990886" watchObservedRunningTime="2026-07-06 19:39:01.739256988 +0000 UTC m=+831.057426160"
Jul 06 19:39:12.722525 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:12.722497    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-96tzh"
Jul 06 19:39:25.396599 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.396569    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"]
Jul 06 19:39:25.401140 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.401121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.404366 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.404341    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:39:25.404366 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.404358    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:39:25.404594 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.404343    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:39:25.404594 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.404343    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pmg8n\""
Jul 06 19:39:25.411714 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.411691    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"]
Jul 06 19:39:25.487356 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.487323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.487527 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.487393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.487527 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.487419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.487527 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.487452    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4c3f59-6e65-4682-b79d-19157c84b729-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.487527 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.487494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjhs5\" (UniqueName: \"kubernetes.io/projected/0e4c3f59-6e65-4682-b79d-19157c84b729-kube-api-access-bjhs5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.487666 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.487533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588437 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4c3f59-6e65-4682-b79d-19157c84b729-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588437 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjhs5\" (UniqueName: \"kubernetes.io/projected/0e4c3f59-6e65-4682-b79d-19157c84b729-kube-api-access-bjhs5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588888 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588867    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.588969 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.588945    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.589049 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.589030    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.590800 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.590779    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e4c3f59-6e65-4682-b79d-19157c84b729-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.591053 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.591036    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e4c3f59-6e65-4682-b79d-19157c84b729-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.596539 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.596516    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjhs5\" (UniqueName: \"kubernetes.io/projected/0e4c3f59-6e65-4682-b79d-19157c84b729-kube-api-access-bjhs5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd\" (UID: \"0e4c3f59-6e65-4682-b79d-19157c84b729\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.713008 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.712933    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:25.859308 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:25.859278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"]
Jul 06 19:39:25.861702 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:39:25.861676    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4c3f59_6e65_4682_b79d_19157c84b729.slice/crio-59051dd56c5f4caa6157f4bd6c6efa66924c69227c7300f61c6f49c76089adfd WatchSource:0}: Error finding container 59051dd56c5f4caa6157f4bd6c6efa66924c69227c7300f61c6f49c76089adfd: Status 404 returned error can't find the container with id 59051dd56c5f4caa6157f4bd6c6efa66924c69227c7300f61c6f49c76089adfd
Jul 06 19:39:26.845053 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:26.845019    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd" event={"ID":"0e4c3f59-6e65-4682-b79d-19157c84b729","Type":"ContainerStarted","Data":"59051dd56c5f4caa6157f4bd6c6efa66924c69227c7300f61c6f49c76089adfd"}
Jul 06 19:39:27.851176 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:27.851135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd" event={"ID":"0e4c3f59-6e65-4682-b79d-19157c84b729","Type":"ContainerStarted","Data":"485f5fb04416c5ce01d7c041b6ce075dc11e25be92c6f65fde3fda45a4be277e"}
Jul 06 19:39:27.868680 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:27.868608    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd" podStartSLOduration=1.758126402 podStartE2EDuration="2.868590896s" totalImagesPullingTime="1.110464494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:27.867940756 +0000 UTC m=+857.186109927" watchObservedRunningTime="2026-07-06 19:39:27.868590896 +0000 UTC m=+857.186760062"
Jul 06 19:39:35.713385 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:35.713348    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:35.713769 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:35.713417    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:35.725683 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:35.725655    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:35.901573 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:35.901548    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd"
Jul 06 19:39:50.994720 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:50.994688    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"]
Jul 06 19:39:50.997856 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:50.997838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.000116 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.000090    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 19:39:51.008884 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.008859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"]
Jul 06 19:39:51.117730 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.117697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.117887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.117734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dhj4\" (UniqueName: \"kubernetes.io/projected/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-kube-api-access-7dhj4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.117887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.117770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.117887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.117828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.117887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.117848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.117887 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.117886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219085 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219291 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219166    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dhj4\" (UniqueName: \"kubernetes.io/projected/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-kube-api-access-7dhj4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219291 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219291 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219284    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219465 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219465 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219642 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219518    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219642 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219613    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.219742 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.219660    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.221562 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.221534    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.221753 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.221738    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.226718 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.226697    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dhj4\" (UniqueName: \"kubernetes.io/projected/00072233-bd0d-4a5a-8803-4b6f40b9b3bd-kube-api-access-7dhj4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fld6h\" (UID: \"00072233-bd0d-4a5a-8803-4b6f40b9b3bd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.307995 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.307917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:39:51.439191 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.439160    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"]
Jul 06 19:39:51.441549 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:39:51.441523    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00072233_bd0d_4a5a_8803_4b6f40b9b3bd.slice/crio-36a6815005bfca5fbbd32262cb2c1a44b9eb8dac58c10067f0b29dd2e7cd59b0 WatchSource:0}: Error finding container 36a6815005bfca5fbbd32262cb2c1a44b9eb8dac58c10067f0b29dd2e7cd59b0: Status 404 returned error can't find the container with id 36a6815005bfca5fbbd32262cb2c1a44b9eb8dac58c10067f0b29dd2e7cd59b0
Jul 06 19:39:51.972069 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.971982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h" event={"ID":"00072233-bd0d-4a5a-8803-4b6f40b9b3bd","Type":"ContainerStarted","Data":"6d8d38596540939704ca31b741ca90a815cd6ac4f802570f89a4c54c2444d57f"}
Jul 06 19:39:51.972069 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.972042    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h" event={"ID":"00072233-bd0d-4a5a-8803-4b6f40b9b3bd","Type":"ContainerStarted","Data":"36a6815005bfca5fbbd32262cb2c1a44b9eb8dac58c10067f0b29dd2e7cd59b0"}
Jul 06 19:39:51.991694 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:39:51.991642    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h" podStartSLOduration=1.717045727 podStartE2EDuration="1.991622568s" totalImagesPullingTime="274.576841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:51.991270262 +0000 UTC m=+881.309439455" watchObservedRunningTime="2026-07-06 19:39:51.991622568 +0000 UTC m=+881.309791738"
Jul 06 19:40:01.308253 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:01.308220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:40:01.308764 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:01.308512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:40:01.320814 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:01.320792    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:40:02.032719 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:02.032690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fld6h"
Jul 06 19:40:10.499402 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.499369    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"]
Jul 06 19:40:10.501850 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.501836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.504192 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.504171    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 19:40:10.515675 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.515651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"]
Jul 06 19:40:10.578384 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.578356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.578549 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.578403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlbhh\" (UniqueName: \"kubernetes.io/projected/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-kube-api-access-hlbhh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.578549 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.578463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.578549 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.578534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.578663 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.578553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.578663 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.578578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679408 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679408 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679664 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679664 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679664 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlbhh\" (UniqueName: \"kubernetes.io/projected/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-kube-api-access-hlbhh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679664 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.679937 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679914    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.680018 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679962    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.680018 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.679968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.681764 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.681735    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.682064 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.682047    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.688613 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.688588    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlbhh\" (UniqueName: \"kubernetes.io/projected/56f74e96-4e2a-41fb-98d6-3ab5a18c8e95-kube-api-access-hlbhh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ql9c4\" (UID: \"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.811552 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.811468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:10.942655 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:10.942631    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"]
Jul 06 19:40:10.944212 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:40:10.944186    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f74e96_4e2a_41fb_98d6_3ab5a18c8e95.slice/crio-9ea1e976de7fe92226b0e11fc467b34d03353f771f42b47a984aa5208f21fcd2 WatchSource:0}: Error finding container 9ea1e976de7fe92226b0e11fc467b34d03353f771f42b47a984aa5208f21fcd2: Status 404 returned error can't find the container with id 9ea1e976de7fe92226b0e11fc467b34d03353f771f42b47a984aa5208f21fcd2
Jul 06 19:40:11.068790 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:11.068709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4" event={"ID":"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95","Type":"ContainerStarted","Data":"9ea1e976de7fe92226b0e11fc467b34d03353f771f42b47a984aa5208f21fcd2"}
Jul 06 19:40:12.075705 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:12.075664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4" event={"ID":"56f74e96-4e2a-41fb-98d6-3ab5a18c8e95","Type":"ContainerStarted","Data":"984ca8a864788ec2c443e8ad4d800ce3b339ef169e7126455bfcb29bb72e8c39"}
Jul 06 19:40:12.095063 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:12.095019    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4" podStartSLOduration=1.920298207 podStartE2EDuration="2.095004726s" totalImagesPullingTime="174.706519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:12.09407518 +0000 UTC m=+901.412244367" watchObservedRunningTime="2026-07-06 19:40:12.095004726 +0000 UTC m=+901.413173882"
Jul 06 19:40:20.811909 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:20.811869    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:20.812327 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:20.811975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:20.824405 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:20.824379    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:40:21.136159 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:40:21.136133    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ql9c4"
Jul 06 19:41:38.216655 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.216564    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64fb6fcbc6-smll5"]
Jul 06 19:41:38.220039 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.220019    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.229979 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.229953    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64fb6fcbc6-smll5"]
Jul 06 19:41:38.347237 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.347201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwztp\" (UniqueName: \"kubernetes.io/projected/bd14bc5a-db77-4bee-b2d6-bd4680041931-kube-api-access-fwztp\") pod \"authorino-64fb6fcbc6-smll5\" (UID: \"bd14bc5a-db77-4bee-b2d6-bd4680041931\") " pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.347408 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.347276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd14bc5a-db77-4bee-b2d6-bd4680041931-tls-cert\") pod \"authorino-64fb6fcbc6-smll5\" (UID: \"bd14bc5a-db77-4bee-b2d6-bd4680041931\") " pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.448021 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.447991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwztp\" (UniqueName: \"kubernetes.io/projected/bd14bc5a-db77-4bee-b2d6-bd4680041931-kube-api-access-fwztp\") pod \"authorino-64fb6fcbc6-smll5\" (UID: \"bd14bc5a-db77-4bee-b2d6-bd4680041931\") " pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.448207 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.448051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd14bc5a-db77-4bee-b2d6-bd4680041931-tls-cert\") pod \"authorino-64fb6fcbc6-smll5\" (UID: \"bd14bc5a-db77-4bee-b2d6-bd4680041931\") " pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.450278 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.450258    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd14bc5a-db77-4bee-b2d6-bd4680041931-tls-cert\") pod \"authorino-64fb6fcbc6-smll5\" (UID: \"bd14bc5a-db77-4bee-b2d6-bd4680041931\") " pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.456649 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.456622    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwztp\" (UniqueName: \"kubernetes.io/projected/bd14bc5a-db77-4bee-b2d6-bd4680041931-kube-api-access-fwztp\") pod \"authorino-64fb6fcbc6-smll5\" (UID: \"bd14bc5a-db77-4bee-b2d6-bd4680041931\") " pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.530043 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.529974    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64fb6fcbc6-smll5"
Jul 06 19:41:38.692473 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:41:38.692446    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd14bc5a_db77_4bee_b2d6_bd4680041931.slice/crio-cd7be99046d12ba0a12bd741cf846e58c492d692c6ecc03d1434d08cd83f5cef WatchSource:0}: Error finding container cd7be99046d12ba0a12bd741cf846e58c492d692c6ecc03d1434d08cd83f5cef: Status 404 returned error can't find the container with id cd7be99046d12ba0a12bd741cf846e58c492d692c6ecc03d1434d08cd83f5cef
Jul 06 19:41:38.695082 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:38.695058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64fb6fcbc6-smll5"]
Jul 06 19:41:39.534054 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.533995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64fb6fcbc6-smll5" event={"ID":"bd14bc5a-db77-4bee-b2d6-bd4680041931","Type":"ContainerStarted","Data":"de7f8d1152f32c533ed8b69aa7af08f9fee13c97790f647921099081f3d28b0b"}
Jul 06 19:41:39.534054 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.534047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64fb6fcbc6-smll5" event={"ID":"bd14bc5a-db77-4bee-b2d6-bd4680041931","Type":"ContainerStarted","Data":"cd7be99046d12ba0a12bd741cf846e58c492d692c6ecc03d1434d08cd83f5cef"}
Jul 06 19:41:39.583359 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.583240    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64fb6fcbc6-smll5" podStartSLOduration=0.948754626 podStartE2EDuration="1.583218183s" totalImagesPullingTime="634.463557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:41:39.553827479 +0000 UTC m=+988.871996646" watchObservedRunningTime="2026-07-06 19:41:39.583218183 +0000 UTC m=+988.901387349"
Jul 06 19:41:39.586993 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.586961    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd9d9f5cc-fs2kz"]
Jul 06 19:41:39.587201 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.587175    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz" podUID="b4f85b88-ff3f-441d-863e-5ba2e7dfef09" containerName="authorino" containerID="cri-o://b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5" gracePeriod=30
Jul 06 19:41:39.862418 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.862384    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:41:39.963557 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.963520    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7vs2\" (UniqueName: \"kubernetes.io/projected/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-kube-api-access-f7vs2\") pod \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") "
Jul 06 19:41:39.963744 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.963699    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-tls-cert\") pod \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\" (UID: \"b4f85b88-ff3f-441d-863e-5ba2e7dfef09\") "
Jul 06 19:41:39.965749 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.965717    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-kube-api-access-f7vs2" (OuterVolumeSpecName: "kube-api-access-f7vs2") pod "b4f85b88-ff3f-441d-863e-5ba2e7dfef09" (UID: "b4f85b88-ff3f-441d-863e-5ba2e7dfef09"). InnerVolumeSpecName "kube-api-access-f7vs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:41:39.974985 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:39.974961    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b4f85b88-ff3f-441d-863e-5ba2e7dfef09" (UID: "b4f85b88-ff3f-441d-863e-5ba2e7dfef09"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:41:40.064658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.064618    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-tls-cert\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:41:40.064658 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.064661    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7vs2\" (UniqueName: \"kubernetes.io/projected/b4f85b88-ff3f-441d-863e-5ba2e7dfef09-kube-api-access-f7vs2\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:41:40.542684 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.542649    2579 generic.go:356] "Generic (PLEG): container finished" podID="b4f85b88-ff3f-441d-863e-5ba2e7dfef09" containerID="b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5" exitCode=0
Jul 06 19:41:40.543056 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.542689    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz"
Jul 06 19:41:40.543056 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.542730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz" event={"ID":"b4f85b88-ff3f-441d-863e-5ba2e7dfef09","Type":"ContainerDied","Data":"b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5"}
Jul 06 19:41:40.543056 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.542774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fd9d9f5cc-fs2kz" event={"ID":"b4f85b88-ff3f-441d-863e-5ba2e7dfef09","Type":"ContainerDied","Data":"fff73ecff31c68f4411991f5b1352e45279524be5b0f0e44617e115ba90ea2da"}
Jul 06 19:41:40.543056 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.542791    2579 scope.go:117] "RemoveContainer" containerID="b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5"
Jul 06 19:41:40.553602 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.553580    2579 scope.go:117] "RemoveContainer" containerID="b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5"
Jul 06 19:41:40.553899 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:41:40.553877    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5\": container with ID starting with b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5 not found: ID does not exist" containerID="b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5"
Jul 06 19:41:40.553976 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.553909    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5"} err="failed to get container status \"b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5\": rpc error: code = NotFound desc = could not find container \"b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5\": container with ID starting with b43a7cc4e5c4f1e2ad6c7dc3dceb9bdb29eb763afddb615c6534bc50b15774a5 not found: ID does not exist"
Jul 06 19:41:40.564628 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.564602    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fd9d9f5cc-fs2kz"]
Jul 06 19:41:40.566932 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:40.566908    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fd9d9f5cc-fs2kz"]
Jul 06 19:41:41.253025 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:41:41.252993    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f85b88-ff3f-441d-863e-5ba2e7dfef09" path="/var/lib/kubelet/pods/b4f85b88-ff3f-441d-863e-5ba2e7dfef09/volumes"
Jul 06 19:42:50.378643 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.378609    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-689c7557c-rsgcl"]
Jul 06 19:42:50.379200 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.378841    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-689c7557c-rsgcl" podUID="527b2d58-6f15-4e24-b7fd-4c752f00fd19" containerName="manager" containerID="cri-o://ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98" gracePeriod=30
Jul 06 19:42:50.632033 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.632015    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:42:50.683375 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.683343    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/527b2d58-6f15-4e24-b7fd-4c752f00fd19-webhook-cert\") pod \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") "
Jul 06 19:42:50.683523 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.683381    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcb4t\" (UniqueName: \"kubernetes.io/projected/527b2d58-6f15-4e24-b7fd-4c752f00fd19-kube-api-access-wcb4t\") pod \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\" (UID: \"527b2d58-6f15-4e24-b7fd-4c752f00fd19\") "
Jul 06 19:42:50.685440 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.685402    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527b2d58-6f15-4e24-b7fd-4c752f00fd19-kube-api-access-wcb4t" (OuterVolumeSpecName: "kube-api-access-wcb4t") pod "527b2d58-6f15-4e24-b7fd-4c752f00fd19" (UID: "527b2d58-6f15-4e24-b7fd-4c752f00fd19"). InnerVolumeSpecName "kube-api-access-wcb4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:42:50.685556 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.685445    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527b2d58-6f15-4e24-b7fd-4c752f00fd19-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "527b2d58-6f15-4e24-b7fd-4c752f00fd19" (UID: "527b2d58-6f15-4e24-b7fd-4c752f00fd19"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:42:50.784549 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.784517    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/527b2d58-6f15-4e24-b7fd-4c752f00fd19-webhook-cert\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:42:50.784549 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.784544    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcb4t\" (UniqueName: \"kubernetes.io/projected/527b2d58-6f15-4e24-b7fd-4c752f00fd19-kube-api-access-wcb4t\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:42:50.924270 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.924182    2579 generic.go:356] "Generic (PLEG): container finished" podID="527b2d58-6f15-4e24-b7fd-4c752f00fd19" containerID="ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98" exitCode=0
Jul 06 19:42:50.924270 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.924224    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689c7557c-rsgcl"
Jul 06 19:42:50.924270 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.924248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-rsgcl" event={"ID":"527b2d58-6f15-4e24-b7fd-4c752f00fd19","Type":"ContainerDied","Data":"ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98"}
Jul 06 19:42:50.924509 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.924293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-rsgcl" event={"ID":"527b2d58-6f15-4e24-b7fd-4c752f00fd19","Type":"ContainerDied","Data":"acbb64f52b6d43c1ebfe82b83c6f67fbd1019b133907d2cb1a76724b4c8226d3"}
Jul 06 19:42:50.924509 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.924315    2579 scope.go:117] "RemoveContainer" containerID="ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98"
Jul 06 19:42:50.934086 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.934069    2579 scope.go:117] "RemoveContainer" containerID="ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98"
Jul 06 19:42:50.934374 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:42:50.934352    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98\": container with ID starting with ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98 not found: ID does not exist" containerID="ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98"
Jul 06 19:42:50.934454 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.934382    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98"} err="failed to get container status \"ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98\": rpc error: code = NotFound desc = could not find container \"ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98\": container with ID starting with ff0593ae984b07e358759acc850bb12d33978cdf000b1ee9514155740e170c98 not found: ID does not exist"
Jul 06 19:42:50.947416 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.947389    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-689c7557c-rsgcl"]
Jul 06 19:42:50.950550 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:50.950529    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-689c7557c-rsgcl"]
Jul 06 19:42:51.251956 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.251884    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527b2d58-6f15-4e24-b7fd-4c752f00fd19" path="/var/lib/kubelet/pods/527b2d58-6f15-4e24-b7fd-4c752f00fd19/volumes"
Jul 06 19:42:51.729316 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729286    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-689c7557c-wh8mz"]
Jul 06 19:42:51.729685 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729636    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527b2d58-6f15-4e24-b7fd-4c752f00fd19" containerName="manager"
Jul 06 19:42:51.729685 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729648    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="527b2d58-6f15-4e24-b7fd-4c752f00fd19" containerName="manager"
Jul 06 19:42:51.729685 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729666    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f85b88-ff3f-441d-863e-5ba2e7dfef09" containerName="authorino"
Jul 06 19:42:51.729685 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729671    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f85b88-ff3f-441d-863e-5ba2e7dfef09" containerName="authorino"
Jul 06 19:42:51.729814 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729730    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f85b88-ff3f-441d-863e-5ba2e7dfef09" containerName="authorino"
Jul 06 19:42:51.729814 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.729739    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="527b2d58-6f15-4e24-b7fd-4c752f00fd19" containerName="manager"
Jul 06 19:42:51.734153 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.734137    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:51.737180 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.737157    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:42:51.737180 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.737157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8fhhp\""
Jul 06 19:42:51.737381 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.737157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:42:51.743277 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.743251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-689c7557c-wh8mz"]
Jul 06 19:42:51.792614 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.792576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6khrl\" (UniqueName: \"kubernetes.io/projected/b5f4e274-48e4-4452-aac7-430a8bc76355-kube-api-access-6khrl\") pod \"maas-controller-689c7557c-wh8mz\" (UID: \"b5f4e274-48e4-4452-aac7-430a8bc76355\") " pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:51.792614 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.792621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5f4e274-48e4-4452-aac7-430a8bc76355-webhook-cert\") pod \"maas-controller-689c7557c-wh8mz\" (UID: \"b5f4e274-48e4-4452-aac7-430a8bc76355\") " pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:51.893477 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.893432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6khrl\" (UniqueName: \"kubernetes.io/projected/b5f4e274-48e4-4452-aac7-430a8bc76355-kube-api-access-6khrl\") pod \"maas-controller-689c7557c-wh8mz\" (UID: \"b5f4e274-48e4-4452-aac7-430a8bc76355\") " pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:51.893646 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.893489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5f4e274-48e4-4452-aac7-430a8bc76355-webhook-cert\") pod \"maas-controller-689c7557c-wh8mz\" (UID: \"b5f4e274-48e4-4452-aac7-430a8bc76355\") " pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:51.895880 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.895857    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5f4e274-48e4-4452-aac7-430a8bc76355-webhook-cert\") pod \"maas-controller-689c7557c-wh8mz\" (UID: \"b5f4e274-48e4-4452-aac7-430a8bc76355\") " pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:51.901828 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:51.901801    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6khrl\" (UniqueName: \"kubernetes.io/projected/b5f4e274-48e4-4452-aac7-430a8bc76355-kube-api-access-6khrl\") pod \"maas-controller-689c7557c-wh8mz\" (UID: \"b5f4e274-48e4-4452-aac7-430a8bc76355\") " pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:52.045229 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:52.045151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:52.173928 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:52.173900    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-689c7557c-wh8mz"]
Jul 06 19:42:52.175394 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:42:52.175368    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f4e274_48e4_4452_aac7_430a8bc76355.slice/crio-ae76bc7c46cd6bff20d4e668e2606d7bbbde8fb346f4c453cdb58a1080a6291f WatchSource:0}: Error finding container ae76bc7c46cd6bff20d4e668e2606d7bbbde8fb346f4c453cdb58a1080a6291f: Status 404 returned error can't find the container with id ae76bc7c46cd6bff20d4e668e2606d7bbbde8fb346f4c453cdb58a1080a6291f
Jul 06 19:42:52.937083 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:52.937049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-wh8mz" event={"ID":"b5f4e274-48e4-4452-aac7-430a8bc76355","Type":"ContainerStarted","Data":"cab43adcdf4a4f44a4465c7237ca093a611a6774f5d54bff87d7c03c767a6d7b"}
Jul 06 19:42:52.937477 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:52.937125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-wh8mz" event={"ID":"b5f4e274-48e4-4452-aac7-430a8bc76355","Type":"ContainerStarted","Data":"ae76bc7c46cd6bff20d4e668e2606d7bbbde8fb346f4c453cdb58a1080a6291f"}
Jul 06 19:42:52.937477 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:52.937174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:42:52.957795 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:42:52.957749    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-689c7557c-wh8mz" podStartSLOduration=1.541436112 podStartE2EDuration="1.957734841s" totalImagesPullingTime="416.298729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:42:52.955435614 +0000 UTC m=+1062.273604781" watchObservedRunningTime="2026-07-06 19:42:52.957734841 +0000 UTC m=+1062.275904007"
Jul 06 19:43:04.096923 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:43:04.096849    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 19:43:14.943452 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:43:14.943414    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-689c7557c-wh8mz" podUID="b5f4e274-48e4-4452-aac7-430a8bc76355" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.47:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:58:52.901830 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.901799    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"]
Jul 06 19:58:52.905591 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.905570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:52.908749 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.908723    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2b7eaa8b\"/\"kube-root-ca.crt\""
Jul 06 19:58:52.908884 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.908746    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2b7eaa8b\"/\"e2e-lifecycle-model-2b7eaa8b-kserve-self-signed-certs\""
Jul 06 19:58:52.908884 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.908798    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2b7eaa8b\"/\"openshift-service-ca.crt\""
Jul 06 19:58:52.908884 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.908835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2b7eaa8b\"/\"default-dockercfg-ngbnc\""
Jul 06 19:58:52.918522 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.918500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"]
Jul 06 19:58:52.974672 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.974642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-model-cache\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:52.974847 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.974683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03e387d-6636-4453-9567-d9e704ba5536-tls-certs\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:52.974847 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.974702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-home\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:52.974847 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.974735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-tmp-dir\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:52.974847 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.974772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-dshm\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:52.974847 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:52.974788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfcq2\" (UniqueName: \"kubernetes.io/projected/f03e387d-6636-4453-9567-d9e704ba5536-kube-api-access-xfcq2\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.075700 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.075662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-model-cache\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.075869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.075712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03e387d-6636-4453-9567-d9e704ba5536-tls-certs\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.075869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.075743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-home\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.075869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.075783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-tmp-dir\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.075869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.075818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-dshm\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.075869 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.075842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfcq2\" (UniqueName: \"kubernetes.io/projected/f03e387d-6636-4453-9567-d9e704ba5536-kube-api-access-xfcq2\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.076121 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.076086    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-model-cache\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.076189 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.076169    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-home\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.076242 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.076228    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-tmp-dir\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.078045 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.078015    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-dshm\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.078305 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.078288    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03e387d-6636-4453-9567-d9e704ba5536-tls-certs\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.085576 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.085547    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfcq2\" (UniqueName: \"kubernetes.io/projected/f03e387d-6636-4453-9567-d9e704ba5536-kube-api-access-xfcq2\") pod \"e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") " pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.215413 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.215325    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:58:53.360850 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:53.360822    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"]
Jul 06 19:58:53.362354 ip-10-0-140-210 kubenswrapper[2579]: W0706 19:58:53.362330    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf03e387d_6636_4453_9567_d9e704ba5536.slice/crio-212dd0aa71237d1de0e993ee4e92288cb41cb84223863a3ed45d3a43ba2adc95 WatchSource:0}: Error finding container 212dd0aa71237d1de0e993ee4e92288cb41cb84223863a3ed45d3a43ba2adc95: Status 404 returned error can't find the container with id 212dd0aa71237d1de0e993ee4e92288cb41cb84223863a3ed45d3a43ba2adc95
Jul 06 19:58:54.017518 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:54.017485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h" event={"ID":"f03e387d-6636-4453-9567-d9e704ba5536","Type":"ContainerStarted","Data":"bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251"}
Jul 06 19:58:54.017518 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:54.017525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h" event={"ID":"f03e387d-6636-4453-9567-d9e704ba5536","Type":"ContainerStarted","Data":"212dd0aa71237d1de0e993ee4e92288cb41cb84223863a3ed45d3a43ba2adc95"}
Jul 06 19:58:54.039697 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:58:54.039651    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h" podStartSLOduration=2.039635895 podStartE2EDuration="2.039635895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:54.037831375 +0000 UTC m=+2023.356000542" watchObservedRunningTime="2026-07-06 19:58:54.039635895 +0000 UTC m=+2023.357805061"
Jul 06 19:59:03.215992 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:03.215955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:59:03.216483 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:03.216040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:59:03.229125 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:03.229074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:59:04.078767 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:04.078741    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:59:27.500903 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:27.500873    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"]
Jul 06 19:59:42.521411 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.521330    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h" podUID="f03e387d-6636-4453-9567-d9e704ba5536" containerName="main" containerID="cri-o://bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251" gracePeriod=45
Jul 06 19:59:42.769919 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.769887    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:59:42.921851 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.921816    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-dshm\") pod \"f03e387d-6636-4453-9567-d9e704ba5536\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") "
Jul 06 19:59:42.922043 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.921864    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-model-cache\") pod \"f03e387d-6636-4453-9567-d9e704ba5536\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") "
Jul 06 19:59:42.922043 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.921934    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-tmp-dir\") pod \"f03e387d-6636-4453-9567-d9e704ba5536\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") "
Jul 06 19:59:42.922043 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.921969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-home\") pod \"f03e387d-6636-4453-9567-d9e704ba5536\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") "
Jul 06 19:59:42.922043 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.921999    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfcq2\" (UniqueName: \"kubernetes.io/projected/f03e387d-6636-4453-9567-d9e704ba5536-kube-api-access-xfcq2\") pod \"f03e387d-6636-4453-9567-d9e704ba5536\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") "
Jul 06 19:59:42.922280 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922043    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03e387d-6636-4453-9567-d9e704ba5536-tls-certs\") pod \"f03e387d-6636-4453-9567-d9e704ba5536\" (UID: \"f03e387d-6636-4453-9567-d9e704ba5536\") "
Jul 06 19:59:42.922280 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922170    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f03e387d-6636-4453-9567-d9e704ba5536" (UID: "f03e387d-6636-4453-9567-d9e704ba5536"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:42.922280 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922185    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-model-cache" (OuterVolumeSpecName: "model-cache") pod "f03e387d-6636-4453-9567-d9e704ba5536" (UID: "f03e387d-6636-4453-9567-d9e704ba5536"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:42.922394 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922305    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-home" (OuterVolumeSpecName: "home") pod "f03e387d-6636-4453-9567-d9e704ba5536" (UID: "f03e387d-6636-4453-9567-d9e704ba5536"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:42.922459 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922411    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-home\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:59:42.922459 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922429    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-model-cache\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:59:42.922459 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.922439    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-tmp-dir\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:59:42.924164 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.924129    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03e387d-6636-4453-9567-d9e704ba5536-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f03e387d-6636-4453-9567-d9e704ba5536" (UID: "f03e387d-6636-4453-9567-d9e704ba5536"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:59:42.924265 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.924133    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-dshm" (OuterVolumeSpecName: "dshm") pod "f03e387d-6636-4453-9567-d9e704ba5536" (UID: "f03e387d-6636-4453-9567-d9e704ba5536"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:42.924265 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:42.924136    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03e387d-6636-4453-9567-d9e704ba5536-kube-api-access-xfcq2" (OuterVolumeSpecName: "kube-api-access-xfcq2") pod "f03e387d-6636-4453-9567-d9e704ba5536" (UID: "f03e387d-6636-4453-9567-d9e704ba5536"). InnerVolumeSpecName "kube-api-access-xfcq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:59:43.023881 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.023846    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03e387d-6636-4453-9567-d9e704ba5536-dshm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:59:43.023881 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.023879    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfcq2\" (UniqueName: \"kubernetes.io/projected/f03e387d-6636-4453-9567-d9e704ba5536-kube-api-access-xfcq2\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:59:43.023881 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.023890    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03e387d-6636-4453-9567-d9e704ba5536-tls-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 19:59:43.291426 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.291393    2579 generic.go:356] "Generic (PLEG): container finished" podID="f03e387d-6636-4453-9567-d9e704ba5536" containerID="bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251" exitCode=0
Jul 06 19:59:43.291602 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.291441    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"
Jul 06 19:59:43.291602 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.291478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h" event={"ID":"f03e387d-6636-4453-9567-d9e704ba5536","Type":"ContainerDied","Data":"bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251"}
Jul 06 19:59:43.291602 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.291521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h" event={"ID":"f03e387d-6636-4453-9567-d9e704ba5536","Type":"ContainerDied","Data":"212dd0aa71237d1de0e993ee4e92288cb41cb84223863a3ed45d3a43ba2adc95"}
Jul 06 19:59:43.291602 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.291541    2579 scope.go:117] "RemoveContainer" containerID="bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251"
Jul 06 19:59:43.300332 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.300317    2579 scope.go:117] "RemoveContainer" containerID="bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251"
Jul 06 19:59:43.300565 ip-10-0-140-210 kubenswrapper[2579]: E0706 19:59:43.300545    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251\": container with ID starting with bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251 not found: ID does not exist" containerID="bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251"
Jul 06 19:59:43.300622 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.300573    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251"} err="failed to get container status \"bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251\": rpc error: code = NotFound desc = could not find container \"bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251\": container with ID starting with bf0c4de663250ac7479cd8789b5ca223d35cad7e71374cf8c1aa543a1f24c251 not found: ID does not exist"
Jul 06 19:59:43.314575 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.314552    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"]
Jul 06 19:59:43.326777 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:43.326755    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2b7eaa8b/e2e-lifecycle-model-2b7eaa8b-kserve-7b84dc844c-cmq7h"]
Jul 06 19:59:45.251742 ip-10-0-140-210 kubenswrapper[2579]: I0706 19:59:45.251706    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03e387d-6636-4453-9567-d9e704ba5536" path="/var/lib/kubelet/pods/f03e387d-6636-4453-9567-d9e704ba5536/volumes"
Jul 06 20:01:04.943246 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:04.943157    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-689c7557c-wh8mz" podUID="b5f4e274-48e4-4452-aac7-430a8bc76355" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.47:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:01:11.750185 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:11.750148    2579 generic.go:356] "Generic (PLEG): container finished" podID="816de7e1-87f7-460b-88c9-6829427561cf" containerID="03bfa4ced6f43495d9c9b700f1683252d3a85b09db1c99b7f6243a38d130ddf2" exitCode=1
Jul 06 20:01:11.750669 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:11.750217    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x" event={"ID":"816de7e1-87f7-460b-88c9-6829427561cf","Type":"ContainerDied","Data":"03bfa4ced6f43495d9c9b700f1683252d3a85b09db1c99b7f6243a38d130ddf2"}
Jul 06 20:01:11.750739 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:11.750709    2579 scope.go:117] "RemoveContainer" containerID="03bfa4ced6f43495d9c9b700f1683252d3a85b09db1c99b7f6243a38d130ddf2"
Jul 06 20:01:11.791900 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:01:11.791869    2579 controller.go:195] "Failed to update lease" err="Put \"https://a1001293894be405898c003abcd1c266-fdf8e22a806cc7ce.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-140-210.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:01:12.757068 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:12.757032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x" event={"ID":"816de7e1-87f7-460b-88c9-6829427561cf","Type":"ContainerStarted","Data":"99bbeac19b96fce8c8d89c4fe0bd5677d9d2ba41239b387b792a05a9f3a2187c"}
Jul 06 20:01:12.757568 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:12.757341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 20:01:13.764247 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.764214    2579 generic.go:356] "Generic (PLEG): container finished" podID="8c0e2394-1317-4758-8c50-e702df02dcca" containerID="86dca566e8af6488e28e32226ff44c810cae98b04cbc27665f24d397f4576475" exitCode=1
Jul 06 20:01:13.764677 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.764294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj" event={"ID":"8c0e2394-1317-4758-8c50-e702df02dcca","Type":"ContainerDied","Data":"86dca566e8af6488e28e32226ff44c810cae98b04cbc27665f24d397f4576475"}
Jul 06 20:01:13.764677 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.764648    2579 scope.go:117] "RemoveContainer" containerID="86dca566e8af6488e28e32226ff44c810cae98b04cbc27665f24d397f4576475"
Jul 06 20:01:13.765899 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.765879    2579 generic.go:356] "Generic (PLEG): container finished" podID="b5f4e274-48e4-4452-aac7-430a8bc76355" containerID="cab43adcdf4a4f44a4465c7237ca093a611a6774f5d54bff87d7c03c767a6d7b" exitCode=1
Jul 06 20:01:13.766002 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.765953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-wh8mz" event={"ID":"b5f4e274-48e4-4452-aac7-430a8bc76355","Type":"ContainerDied","Data":"cab43adcdf4a4f44a4465c7237ca093a611a6774f5d54bff87d7c03c767a6d7b"}
Jul 06 20:01:13.766281 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.766264    2579 scope.go:117] "RemoveContainer" containerID="cab43adcdf4a4f44a4465c7237ca093a611a6774f5d54bff87d7c03c767a6d7b"
Jul 06 20:01:13.766617 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.766596    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:01:13.767696 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.767680    2579 generic.go:356] "Generic (PLEG): container finished" podID="ad4f0481-d168-4170-a987-3b55ec7c2a6c" containerID="69eda11469d228df6166cb6836503232847ec2ac7fa1eb8f158223072c0f32c9" exitCode=1
Jul 06 20:01:13.767815 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.767706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht" event={"ID":"ad4f0481-d168-4170-a987-3b55ec7c2a6c","Type":"ContainerDied","Data":"69eda11469d228df6166cb6836503232847ec2ac7fa1eb8f158223072c0f32c9"}
Jul 06 20:01:13.767973 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.767957    2579 scope.go:117] "RemoveContainer" containerID="69eda11469d228df6166cb6836503232847ec2ac7fa1eb8f158223072c0f32c9"
Jul 06 20:01:13.943007 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:13.942971    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 20:01:14.077922 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.077903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 20:01:14.240170 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.240147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 20:01:14.774959 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.774929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj" event={"ID":"8c0e2394-1317-4758-8c50-e702df02dcca","Type":"ContainerStarted","Data":"7d2882918b1c3e372516c2720b8ccb24bbb943840545267c350a4006427bd49f"}
Jul 06 20:01:14.775452 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.775049    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 20:01:14.776760 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.776738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-689c7557c-wh8mz" event={"ID":"b5f4e274-48e4-4452-aac7-430a8bc76355","Type":"ContainerStarted","Data":"b0d2f8d56e04c4172cc88ba3f1d4477e3156ba455fbbc1c8a17edcb037bfc441"}
Jul 06 20:01:14.776885 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.776784    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 20:01:14.778442 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.778423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht" event={"ID":"ad4f0481-d168-4170-a987-3b55ec7c2a6c","Type":"ContainerStarted","Data":"bb4ab76aca04036dd4d864e002edb7248f847fd78285c194935d6e6b8d100b0e"}
Jul 06 20:01:14.778630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:14.778615    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 20:01:16.456558 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:01:16.456523    2579 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-140-210.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Jul 06 20:01:23.769781 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:23.769749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9gw7x"
Jul 06 20:01:25.785319 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:25.785290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dwcht"
Jul 06 20:01:25.785744 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:25.785458    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-t9jpj"
Jul 06 20:01:25.788327 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:01:25.788308    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-689c7557c-wh8mz"
Jul 06 20:02:35.707531 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.707454    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"]
Jul 06 20:02:35.707963 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.707845    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03e387d-6636-4453-9567-d9e704ba5536" containerName="main"
Jul 06 20:02:35.707963 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.707855    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03e387d-6636-4453-9567-d9e704ba5536" containerName="main"
Jul 06 20:02:35.707963 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.707922    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03e387d-6636-4453-9567-d9e704ba5536" containerName="main"
Jul 06 20:02:35.710943 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.710927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.713963 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.713936    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-749ce0\"/\"kube-root-ca.crt\""
Jul 06 20:02:35.714127 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.714004    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-749ce0\"/\"default-dockercfg-t7l6x\""
Jul 06 20:02:35.714127 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.714005    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-749ce0\"/\"openshift-service-ca.crt\""
Jul 06 20:02:35.714127 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.714005    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-749ce0\"/\"test-model-749ce0-kserve-self-signed-certs\""
Jul 06 20:02:35.722240 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.722220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"]
Jul 06 20:02:35.843747 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.843716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tmp-dir\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.843923 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.843767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-home\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.843923 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.843794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tls-certs\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.843923 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.843812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76jm\" (UniqueName: \"kubernetes.io/projected/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-kube-api-access-j76jm\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.843923 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.843837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-dshm\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.844061 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.843923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-model-cache\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.944662 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.944620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-dshm\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.944855 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.944680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-model-cache\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.944855 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.944704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tmp-dir\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.944855 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.944740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-home\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.945022 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.944854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tls-certs\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.945022 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.944895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76jm\" (UniqueName: \"kubernetes.io/projected/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-kube-api-access-j76jm\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.945191 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.945099    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tmp-dir\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.945278 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.945185    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-model-cache\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.945278 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.945250    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-home\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.947044 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.947016    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-dshm\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.947305 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.947288    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tls-certs\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:35.954280 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:35.954247    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76jm\" (UniqueName: \"kubernetes.io/projected/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-kube-api-access-j76jm\") pod \"test-model-749ce0-kserve-59d8c6f7d5-rzr5b\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") " pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:36.023060 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:36.022993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:36.154302 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:36.154275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"]
Jul 06 20:02:36.156607 ip-10-0-140-210 kubenswrapper[2579]: W0706 20:02:36.156582    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0e6bdc2_76e4_4cf3_8255_e54196b5c644.slice/crio-24ded5aeb7184b29fdd42454653a7f6734b59e39a2712514a63209cd9a74e89e WatchSource:0}: Error finding container 24ded5aeb7184b29fdd42454653a7f6734b59e39a2712514a63209cd9a74e89e: Status 404 returned error can't find the container with id 24ded5aeb7184b29fdd42454653a7f6734b59e39a2712514a63209cd9a74e89e
Jul 06 20:02:36.209167 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:36.209139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b" event={"ID":"d0e6bdc2-76e4-4cf3-8255-e54196b5c644","Type":"ContainerStarted","Data":"24ded5aeb7184b29fdd42454653a7f6734b59e39a2712514a63209cd9a74e89e"}
Jul 06 20:02:37.215630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:37.215592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b" event={"ID":"d0e6bdc2-76e4-4cf3-8255-e54196b5c644","Type":"ContainerStarted","Data":"1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc"}
Jul 06 20:02:37.238758 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:37.238712    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b" podStartSLOduration=2.2386966 podStartE2EDuration="2.2386966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:37.236782714 +0000 UTC m=+2246.554951880" watchObservedRunningTime="2026-07-06 20:02:37.2386966 +0000 UTC m=+2246.556865809"
Jul 06 20:02:46.024032 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:46.023974    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:46.024465 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:46.024051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:46.036493 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:46.036466    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:02:46.281422 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:02:46.281344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:03:06.785543 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:06.785501    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-689c7557c-wh8mz" podUID="b5f4e274-48e4-4452-aac7-430a8bc76355" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.47:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:03:12.685013 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.684973    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"]
Jul 06 20:03:12.688640 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.688619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.691592 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.691565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fc607d\"/\"openshift-service-ca.crt\""
Jul 06 20:03:12.691783 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.691759    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fc607d\"/\"default-dockercfg-gj578\""
Jul 06 20:03:12.692511 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.692490    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fc607d\"/\"test-model-fc607d-kserve-self-signed-certs\""
Jul 06 20:03:12.692640 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.692549    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fc607d\"/\"kube-root-ca.crt\""
Jul 06 20:03:12.766691 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.766666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-tmp-dir\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.766803 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.766698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3170daa9-d289-4c78-a894-3a6ef710ec25-tls-certs\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.766803 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.766735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-home\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.766803 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.766766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-model-cache\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.766908 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.766818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-dshm\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.766908 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.766841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5czl\" (UniqueName: \"kubernetes.io/projected/3170daa9-d289-4c78-a894-3a6ef710ec25-kube-api-access-l5czl\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.867649 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.867598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-dshm\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.867649 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.867650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5czl\" (UniqueName: \"kubernetes.io/projected/3170daa9-d289-4c78-a894-3a6ef710ec25-kube-api-access-l5czl\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.867872 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.867710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-tmp-dir\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.867872 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.867734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3170daa9-d289-4c78-a894-3a6ef710ec25-tls-certs\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.867872 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.867761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-home\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.867872 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.867784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-model-cache\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.868228 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.868193    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-tmp-dir\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.868228 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.868208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-home\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.868408 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.868240    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-model-cache\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.869902 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.869884    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-dshm\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:12.870230 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:12.870214    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3170daa9-d289-4c78-a894-3a6ef710ec25-tls-certs\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:14.139442 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:14.139402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"]
Jul 06 20:03:15.703855 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:15.703824    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5czl\" (UniqueName: \"kubernetes.io/projected/3170daa9-d289-4c78-a894-3a6ef710ec25-kube-api-access-l5czl\") pod \"test-model-fc607d-kserve-85658dd8bf-5khhz\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") " pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:15.998580 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:15.998478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:16.146338 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:16.146310    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"]
Jul 06 20:03:16.148605 ip-10-0-140-210 kubenswrapper[2579]: W0706 20:03:16.148576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3170daa9_d289_4c78_a894_3a6ef710ec25.slice/crio-19272814aef3beb8ae9962e8b50b1a57d97c5daa4639f9ff58c686d00c6f3c9f WatchSource:0}: Error finding container 19272814aef3beb8ae9962e8b50b1a57d97c5daa4639f9ff58c686d00c6f3c9f: Status 404 returned error can't find the container with id 19272814aef3beb8ae9962e8b50b1a57d97c5daa4639f9ff58c686d00c6f3c9f
Jul 06 20:03:16.429285 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:16.429247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz" event={"ID":"3170daa9-d289-4c78-a894-3a6ef710ec25","Type":"ContainerStarted","Data":"926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a"}
Jul 06 20:03:16.429479 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:16.429300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz" event={"ID":"3170daa9-d289-4c78-a894-3a6ef710ec25","Type":"ContainerStarted","Data":"19272814aef3beb8ae9962e8b50b1a57d97c5daa4639f9ff58c686d00c6f3c9f"}
Jul 06 20:03:16.450402 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:16.450353    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz" podStartSLOduration=7.450336852 podStartE2EDuration="7.450336852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:16.447590461 +0000 UTC m=+2285.765759656" watchObservedRunningTime="2026-07-06 20:03:16.450336852 +0000 UTC m=+2285.768506062"
Jul 06 20:03:25.999661 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:25.999626    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:26.000048 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:25.999684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:26.012050 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:26.012027    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:03:26.493887 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:03:26.493856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:04:14.759728 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:14.759640    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"]
Jul 06 20:04:15.944909 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:15.944878    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"]
Jul 06 20:04:29.779785 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:29.779742    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b" podUID="d0e6bdc2-76e4-4cf3-8255-e54196b5c644" containerName="main" containerID="cri-o://1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc" gracePeriod=45
Jul 06 20:04:30.037284 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.037219    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:04:30.168455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.168002    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-model-cache\") pod \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") "
Jul 06 20:04:30.168455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.168074    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j76jm\" (UniqueName: \"kubernetes.io/projected/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-kube-api-access-j76jm\") pod \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") "
Jul 06 20:04:30.168455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.168159    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tmp-dir\") pod \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") "
Jul 06 20:04:30.168455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.168184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-dshm\") pod \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") "
Jul 06 20:04:30.168455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.168261    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tls-certs\") pod \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") "
Jul 06 20:04:30.168455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.168346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-home\") pod \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\" (UID: \"d0e6bdc2-76e4-4cf3-8255-e54196b5c644\") "
Jul 06 20:04:30.169129 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.169073    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-home" (OuterVolumeSpecName: "home") pod "d0e6bdc2-76e4-4cf3-8255-e54196b5c644" (UID: "d0e6bdc2-76e4-4cf3-8255-e54196b5c644"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:30.173841 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.169298    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0e6bdc2-76e4-4cf3-8255-e54196b5c644" (UID: "d0e6bdc2-76e4-4cf3-8255-e54196b5c644"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:30.173841 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.172054    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-kube-api-access-j76jm" (OuterVolumeSpecName: "kube-api-access-j76jm") pod "d0e6bdc2-76e4-4cf3-8255-e54196b5c644" (UID: "d0e6bdc2-76e4-4cf3-8255-e54196b5c644"). InnerVolumeSpecName "kube-api-access-j76jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:04:30.173841 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.172289    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0e6bdc2-76e4-4cf3-8255-e54196b5c644" (UID: "d0e6bdc2-76e4-4cf3-8255-e54196b5c644"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:30.174498 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.174468    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-dshm" (OuterVolumeSpecName: "dshm") pod "d0e6bdc2-76e4-4cf3-8255-e54196b5c644" (UID: "d0e6bdc2-76e4-4cf3-8255-e54196b5c644"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:30.176544 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.176518    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0e6bdc2-76e4-4cf3-8255-e54196b5c644" (UID: "d0e6bdc2-76e4-4cf3-8255-e54196b5c644"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:04:30.269426 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.269391    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tls-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:30.269426 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.269419    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-home\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:30.269426 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.269428    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-model-cache\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:30.269643 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.269437    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j76jm\" (UniqueName: \"kubernetes.io/projected/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-kube-api-access-j76jm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:30.269643 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.269446    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-tmp-dir\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:30.269643 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.269455    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0e6bdc2-76e4-4cf3-8255-e54196b5c644-dshm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:30.831423 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.831391    2579 generic.go:356] "Generic (PLEG): container finished" podID="d0e6bdc2-76e4-4cf3-8255-e54196b5c644" containerID="1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc" exitCode=0
Jul 06 20:04:30.831913 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.831442    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"
Jul 06 20:04:30.831913 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.831478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b" event={"ID":"d0e6bdc2-76e4-4cf3-8255-e54196b5c644","Type":"ContainerDied","Data":"1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc"}
Jul 06 20:04:30.831913 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.831531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b" event={"ID":"d0e6bdc2-76e4-4cf3-8255-e54196b5c644","Type":"ContainerDied","Data":"24ded5aeb7184b29fdd42454653a7f6734b59e39a2712514a63209cd9a74e89e"}
Jul 06 20:04:30.831913 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.831556    2579 scope.go:117] "RemoveContainer" containerID="1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc"
Jul 06 20:04:30.841338 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.841308    2579 scope.go:117] "RemoveContainer" containerID="1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc"
Jul 06 20:04:30.841591 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:04:30.841570    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc\": container with ID starting with 1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc not found: ID does not exist" containerID="1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc"
Jul 06 20:04:30.841655 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.841599    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc"} err="failed to get container status \"1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc\": rpc error: code = NotFound desc = could not find container \"1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc\": container with ID starting with 1306edfcef8489761ac45db049dd5e2bde238d5cc82f53f7287afc542a958acc not found: ID does not exist"
Jul 06 20:04:30.860381 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.860357    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"]
Jul 06 20:04:30.863093 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.863071    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-749ce0/test-model-749ce0-kserve-59d8c6f7d5-rzr5b"]
Jul 06 20:04:30.965708 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:30.965671    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz" podUID="3170daa9-d289-4c78-a894-3a6ef710ec25" containerName="main" containerID="cri-o://926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a" gracePeriod=45
Jul 06 20:04:31.217298 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.217276    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:04:31.252887 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.252859    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0e6bdc2-76e4-4cf3-8255-e54196b5c644" path="/var/lib/kubelet/pods/d0e6bdc2-76e4-4cf3-8255-e54196b5c644/volumes"
Jul 06 20:04:31.276924 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.276898    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-tmp-dir\") pod \"3170daa9-d289-4c78-a894-3a6ef710ec25\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") "
Jul 06 20:04:31.277083 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.276950    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3170daa9-d289-4c78-a894-3a6ef710ec25-tls-certs\") pod \"3170daa9-d289-4c78-a894-3a6ef710ec25\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") "
Jul 06 20:04:31.277083 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.276977    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-model-cache\") pod \"3170daa9-d289-4c78-a894-3a6ef710ec25\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") "
Jul 06 20:04:31.277083 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-home\") pod \"3170daa9-d289-4c78-a894-3a6ef710ec25\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") "
Jul 06 20:04:31.277279 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-dshm\") pod \"3170daa9-d289-4c78-a894-3a6ef710ec25\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") "
Jul 06 20:04:31.277279 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5czl\" (UniqueName: \"kubernetes.io/projected/3170daa9-d289-4c78-a894-3a6ef710ec25-kube-api-access-l5czl\") pod \"3170daa9-d289-4c78-a894-3a6ef710ec25\" (UID: \"3170daa9-d289-4c78-a894-3a6ef710ec25\") "
Jul 06 20:04:31.277279 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277169    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3170daa9-d289-4c78-a894-3a6ef710ec25" (UID: "3170daa9-d289-4c78-a894-3a6ef710ec25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:31.277429 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277276    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-model-cache" (OuterVolumeSpecName: "model-cache") pod "3170daa9-d289-4c78-a894-3a6ef710ec25" (UID: "3170daa9-d289-4c78-a894-3a6ef710ec25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:31.277429 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277315    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-home" (OuterVolumeSpecName: "home") pod "3170daa9-d289-4c78-a894-3a6ef710ec25" (UID: "3170daa9-d289-4c78-a894-3a6ef710ec25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:31.277529 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277497    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-home\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:31.277529 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277515    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-tmp-dir\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:31.277608 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.277530    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-model-cache\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:31.279199 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.279172    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3170daa9-d289-4c78-a894-3a6ef710ec25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3170daa9-d289-4c78-a894-3a6ef710ec25" (UID: "3170daa9-d289-4c78-a894-3a6ef710ec25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:04:31.279289 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.279240    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3170daa9-d289-4c78-a894-3a6ef710ec25-kube-api-access-l5czl" (OuterVolumeSpecName: "kube-api-access-l5czl") pod "3170daa9-d289-4c78-a894-3a6ef710ec25" (UID: "3170daa9-d289-4c78-a894-3a6ef710ec25"). InnerVolumeSpecName "kube-api-access-l5czl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:04:31.279289 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.279244    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-dshm" (OuterVolumeSpecName: "dshm") pod "3170daa9-d289-4c78-a894-3a6ef710ec25" (UID: "3170daa9-d289-4c78-a894-3a6ef710ec25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:04:31.378171 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.378070    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3170daa9-d289-4c78-a894-3a6ef710ec25-tls-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:31.378171 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.378096    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3170daa9-d289-4c78-a894-3a6ef710ec25-dshm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:31.378171 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.378129    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5czl\" (UniqueName: \"kubernetes.io/projected/3170daa9-d289-4c78-a894-3a6ef710ec25-kube-api-access-l5czl\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:04:31.839872 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.839836    2579 generic.go:356] "Generic (PLEG): container finished" podID="3170daa9-d289-4c78-a894-3a6ef710ec25" containerID="926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a" exitCode=0
Jul 06 20:04:31.840403 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.839881    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"
Jul 06 20:04:31.840403 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.839920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz" event={"ID":"3170daa9-d289-4c78-a894-3a6ef710ec25","Type":"ContainerDied","Data":"926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a"}
Jul 06 20:04:31.840403 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.839974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz" event={"ID":"3170daa9-d289-4c78-a894-3a6ef710ec25","Type":"ContainerDied","Data":"19272814aef3beb8ae9962e8b50b1a57d97c5daa4639f9ff58c686d00c6f3c9f"}
Jul 06 20:04:31.840403 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.839998    2579 scope.go:117] "RemoveContainer" containerID="926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a"
Jul 06 20:04:31.849557 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.849542    2579 scope.go:117] "RemoveContainer" containerID="926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a"
Jul 06 20:04:31.849833 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:04:31.849809    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a\": container with ID starting with 926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a not found: ID does not exist" containerID="926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a"
Jul 06 20:04:31.849894 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.849845    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a"} err="failed to get container status \"926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a\": rpc error: code = NotFound desc = could not find container \"926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a\": container with ID starting with 926f759939191bce433849de7497f5d6c734e2825123e84aa8a826b9f76b3a7a not found: ID does not exist"
Jul 06 20:04:31.866313 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.866287    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"]
Jul 06 20:04:31.871480 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:31.871457    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fc607d/test-model-fc607d-kserve-85658dd8bf-5khhz"]
Jul 06 20:04:33.251486 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:04:33.251459    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3170daa9-d289-4c78-a894-3a6ef710ec25" path="/var/lib/kubelet/pods/3170daa9-d289-4c78-a894-3a6ef710ec25/volumes"
Jul 06 20:06:12.913696 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.913664    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"]
Jul 06 20:06:12.914117 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.914039    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0e6bdc2-76e4-4cf3-8255-e54196b5c644" containerName="main"
Jul 06 20:06:12.914117 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.914050    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0e6bdc2-76e4-4cf3-8255-e54196b5c644" containerName="main"
Jul 06 20:06:12.914117 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.914064    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3170daa9-d289-4c78-a894-3a6ef710ec25" containerName="main"
Jul 06 20:06:12.914117 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.914070    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3170daa9-d289-4c78-a894-3a6ef710ec25" containerName="main"
Jul 06 20:06:12.914257 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.914143    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0e6bdc2-76e4-4cf3-8255-e54196b5c644" containerName="main"
Jul 06 20:06:12.914257 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.914153    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3170daa9-d289-4c78-a894-3a6ef710ec25" containerName="main"
Jul 06 20:06:12.917098 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.917080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:12.919875 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.919855    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7ba461\"/\"kube-root-ca.crt\""
Jul 06 20:06:12.919975 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.919910    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7ba461\"/\"openshift-service-ca.crt\""
Jul 06 20:06:12.920091 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.919979    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ba461\"/\"default-dockercfg-gdlcq\""
Jul 06 20:06:12.920091 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.920084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ba461\"/\"auth-test-model-7ba461-kserve-self-signed-certs\""
Jul 06 20:06:12.934260 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.934239    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"]
Jul 06 20:06:12.960324 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.960285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-dshm\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:12.960487 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.960326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-home\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:12.960487 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.960368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-model-cache\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:12.960487 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.960417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tmp-dir\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:12.960487 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.960482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tls-certs\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:12.960674 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:12.960531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wddj\" (UniqueName: \"kubernetes.io/projected/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-kube-api-access-2wddj\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061347 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-home\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061549 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-model-cache\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061549 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tmp-dir\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061549 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tls-certs\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061549 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wddj\" (UniqueName: \"kubernetes.io/projected/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-kube-api-access-2wddj\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061549 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-dshm\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061820 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061789    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-home\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061905 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-model-cache\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.061905 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.061883    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tmp-dir\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.064254 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.064213    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-dshm\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.064599 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.064572    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tls-certs\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.071696 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.071674    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wddj\" (UniqueName: \"kubernetes.io/projected/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-kube-api-access-2wddj\") pod \"auth-test-model-7ba461-kserve-75f54c4c55-8mtxl\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") " pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.226908 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.226816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:13.362419 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.362394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"]
Jul 06 20:06:13.364240 ip-10-0-140-210 kubenswrapper[2579]: W0706 20:06:13.364215    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a919ac9_b3f2_47c9_b148_b4f0d07b6190.slice/crio-b37173e99818a5774f4f7445d22c0ff62b9267ea8e7da36ce93d1066e4133fbf WatchSource:0}: Error finding container b37173e99818a5774f4f7445d22c0ff62b9267ea8e7da36ce93d1066e4133fbf: Status 404 returned error can't find the container with id b37173e99818a5774f4f7445d22c0ff62b9267ea8e7da36ce93d1066e4133fbf
Jul 06 20:06:13.379674 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:13.379644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl" event={"ID":"1a919ac9-b3f2-47c9-b148-b4f0d07b6190","Type":"ContainerStarted","Data":"b37173e99818a5774f4f7445d22c0ff62b9267ea8e7da36ce93d1066e4133fbf"}
Jul 06 20:06:14.386989 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:14.386956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl" event={"ID":"1a919ac9-b3f2-47c9-b148-b4f0d07b6190","Type":"ContainerStarted","Data":"76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82"}
Jul 06 20:06:14.412385 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:14.412336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl" podStartSLOduration=2.412321428 podStartE2EDuration="2.412321428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:14.41109868 +0000 UTC m=+2463.729267852" watchObservedRunningTime="2026-07-06 20:06:14.412321428 +0000 UTC m=+2463.730490594"
Jul 06 20:06:23.227527 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:23.227484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:23.228134 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:23.227745    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:23.240652 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:23.240626    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:06:23.447513 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:06:23.447484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:08:45.419697 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:45.419621    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"]
Jul 06 20:08:57.322455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.322423    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"]
Jul 06 20:08:57.325888 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.325871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.328207 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.328176    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ba461\"/\"sub-test-model-7ba461-kserve-self-signed-certs\""
Jul 06 20:08:57.337770 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.337742    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"]
Jul 06 20:08:57.404972 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.404936    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-model-cache\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.405170 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.404995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr62m\" (UniqueName: \"kubernetes.io/projected/c26aca21-415c-41f9-bb70-3f1be32c2476-kube-api-access-fr62m\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.405170 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.405074    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-home\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.405170 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.405153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-tmp-dir\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.405293 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.405190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26aca21-415c-41f9-bb70-3f1be32c2476-tls-certs\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.405293 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.405215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-dshm\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.506815 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.506757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-home\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507020 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.506856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-tmp-dir\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507020 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.506904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26aca21-415c-41f9-bb70-3f1be32c2476-tls-certs\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507020 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.506935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-dshm\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507217 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.507040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-model-cache\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507279 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.507216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr62m\" (UniqueName: \"kubernetes.io/projected/c26aca21-415c-41f9-bb70-3f1be32c2476-kube-api-access-fr62m\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507279 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.507236    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-home\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507550 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.507521    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-model-cache\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.507686 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.507590    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-tmp-dir\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.509347 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.509323    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-dshm\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.509628 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.509606    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26aca21-415c-41f9-bb70-3f1be32c2476-tls-certs\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.517458 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.517433    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr62m\" (UniqueName: \"kubernetes.io/projected/c26aca21-415c-41f9-bb70-3f1be32c2476-kube-api-access-fr62m\") pod \"sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") " pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.635695 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.635659    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:08:57.774078 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:57.774054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"]
Jul 06 20:08:57.776043 ip-10-0-140-210 kubenswrapper[2579]: W0706 20:08:57.776016    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc26aca21_415c_41f9_bb70_3f1be32c2476.slice/crio-81aea15bd4412f00baa455f7a6c9e3c8106deb4c7a0596c5383629d7104e1041 WatchSource:0}: Error finding container 81aea15bd4412f00baa455f7a6c9e3c8106deb4c7a0596c5383629d7104e1041: Status 404 returned error can't find the container with id 81aea15bd4412f00baa455f7a6c9e3c8106deb4c7a0596c5383629d7104e1041
Jul 06 20:08:58.251793 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:58.251747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2" event={"ID":"c26aca21-415c-41f9-bb70-3f1be32c2476","Type":"ContainerStarted","Data":"7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381"}
Jul 06 20:08:58.251944 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:58.251807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2" event={"ID":"c26aca21-415c-41f9-bb70-3f1be32c2476","Type":"ContainerStarted","Data":"81aea15bd4412f00baa455f7a6c9e3c8106deb4c7a0596c5383629d7104e1041"}
Jul 06 20:08:58.273635 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:08:58.273579    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2" podStartSLOduration=1.273545903 podStartE2EDuration="1.273545903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:08:58.27202077 +0000 UTC m=+2627.590189939" watchObservedRunningTime="2026-07-06 20:08:58.273545903 +0000 UTC m=+2627.591715069"
Jul 06 20:09:00.439691 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.439641    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl" podUID="1a919ac9-b3f2-47c9-b148-b4f0d07b6190" containerName="main" containerID="cri-o://76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82" gracePeriod=45
Jul 06 20:09:00.694817 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.694758    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:09:00.838937 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.838905    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-dshm\") pod \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") "
Jul 06 20:09:00.838937 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.838941    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-model-cache\") pod \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") "
Jul 06 20:09:00.839231 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tls-certs\") pod \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") "
Jul 06 20:09:00.839231 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-home\") pod \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") "
Jul 06 20:09:00.839231 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wddj\" (UniqueName: \"kubernetes.io/projected/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-kube-api-access-2wddj\") pod \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") "
Jul 06 20:09:00.839231 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839196    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tmp-dir\") pod \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\" (UID: \"1a919ac9-b3f2-47c9-b148-b4f0d07b6190\") "
Jul 06 20:09:00.839451 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839261    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a919ac9-b3f2-47c9-b148-b4f0d07b6190" (UID: "1a919ac9-b3f2-47c9-b148-b4f0d07b6190"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:00.839451 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839303    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-home" (OuterVolumeSpecName: "home") pod "1a919ac9-b3f2-47c9-b148-b4f0d07b6190" (UID: "1a919ac9-b3f2-47c9-b148-b4f0d07b6190"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:00.839561 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839496    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-home\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:09:00.839561 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839508    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-model-cache\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:09:00.839561 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.839518    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a919ac9-b3f2-47c9-b148-b4f0d07b6190" (UID: "1a919ac9-b3f2-47c9-b148-b4f0d07b6190"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:00.841253 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.841232    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-dshm" (OuterVolumeSpecName: "dshm") pod "1a919ac9-b3f2-47c9-b148-b4f0d07b6190" (UID: "1a919ac9-b3f2-47c9-b148-b4f0d07b6190"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:09:00.841335 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.841284    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-kube-api-access-2wddj" (OuterVolumeSpecName: "kube-api-access-2wddj") pod "1a919ac9-b3f2-47c9-b148-b4f0d07b6190" (UID: "1a919ac9-b3f2-47c9-b148-b4f0d07b6190"). InnerVolumeSpecName "kube-api-access-2wddj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:09:00.841404 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.841387    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a919ac9-b3f2-47c9-b148-b4f0d07b6190" (UID: "1a919ac9-b3f2-47c9-b148-b4f0d07b6190"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:09:00.940157 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.940125    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tmp-dir\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:09:00.940157 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.940151    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-dshm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:09:00.940157 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.940161    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-tls-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:09:00.940383 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:00.940170    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wddj\" (UniqueName: \"kubernetes.io/projected/1a919ac9-b3f2-47c9-b148-b4f0d07b6190-kube-api-access-2wddj\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:09:01.267745 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.267717    2579 generic.go:356] "Generic (PLEG): container finished" podID="1a919ac9-b3f2-47c9-b148-b4f0d07b6190" containerID="76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82" exitCode=0
Jul 06 20:09:01.267899 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.267751    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"
Jul 06 20:09:01.267899 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.267797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl" event={"ID":"1a919ac9-b3f2-47c9-b148-b4f0d07b6190","Type":"ContainerDied","Data":"76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82"}
Jul 06 20:09:01.267899 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.267833    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl" event={"ID":"1a919ac9-b3f2-47c9-b148-b4f0d07b6190","Type":"ContainerDied","Data":"b37173e99818a5774f4f7445d22c0ff62b9267ea8e7da36ce93d1066e4133fbf"}
Jul 06 20:09:01.267899 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.267850    2579 scope.go:117] "RemoveContainer" containerID="76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82"
Jul 06 20:09:01.277306 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.277287    2579 scope.go:117] "RemoveContainer" containerID="76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82"
Jul 06 20:09:01.277568 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:09:01.277552    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82\": container with ID starting with 76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82 not found: ID does not exist" containerID="76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82"
Jul 06 20:09:01.277607 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.277576    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82"} err="failed to get container status \"76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82\": rpc error: code = NotFound desc = could not find container \"76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82\": container with ID starting with 76e7371fa3b331e1ea3e02476c6e8f96060d78aae036b157f89973b8e464db82 not found: ID does not exist"
Jul 06 20:09:01.288309 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.288287    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"]
Jul 06 20:09:01.292228 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:01.292207    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/auth-test-model-7ba461-kserve-75f54c4c55-8mtxl"]
Jul 06 20:09:03.251237 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:03.251200    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a919ac9-b3f2-47c9-b148-b4f0d07b6190" path="/var/lib/kubelet/pods/1a919ac9-b3f2-47c9-b148-b4f0d07b6190/volumes"
Jul 06 20:09:07.636145 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:07.636089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:09:07.636145 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:07.636156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:09:07.648719 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:07.648690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:09:08.319764 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:09:08.319732    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:10:12.666802 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:12.666765    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"]
Jul 06 20:10:17.012613 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.012578    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"]
Jul 06 20:10:17.012999 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.012985    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a919ac9-b3f2-47c9-b148-b4f0d07b6190" containerName="main"
Jul 06 20:10:17.013048 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.013000    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a919ac9-b3f2-47c9-b148-b4f0d07b6190" containerName="main"
Jul 06 20:10:17.013084 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.013078    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a919ac9-b3f2-47c9-b148-b4f0d07b6190" containerName="main"
Jul 06 20:10:17.016167 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.016150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.018466 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.018441    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7ba461\"/\"rate-test-model-7ba461-kserve-self-signed-certs\""
Jul 06 20:10:17.038048 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.038024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"]
Jul 06 20:10:17.048665 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.048641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-tmp-dir\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.048803 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.048747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-dshm\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.048803 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.048786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-model-cache\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.048896 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.048825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68597350-6dce-409b-a860-2f87113ea45b-tls-certs\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.048896 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.048852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-home\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.048896 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.048874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc5td\" (UniqueName: \"kubernetes.io/projected/68597350-6dce-409b-a860-2f87113ea45b-kube-api-access-jc5td\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.149848 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.149816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-dshm\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150031 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.149857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-model-cache\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150031 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.149887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68597350-6dce-409b-a860-2f87113ea45b-tls-certs\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150031 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.149917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-home\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150031 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.149948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc5td\" (UniqueName: \"kubernetes.io/projected/68597350-6dce-409b-a860-2f87113ea45b-kube-api-access-jc5td\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150031 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.149987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-tmp-dir\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150334 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.150318    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-model-cache\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150385 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.150350    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-home\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.150455 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.150433    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-tmp-dir\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.152269 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.152238    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-dshm\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.152427 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.152409    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68597350-6dce-409b-a860-2f87113ea45b-tls-certs\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.160695 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.160670    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc5td\" (UniqueName: \"kubernetes.io/projected/68597350-6dce-409b-a860-2f87113ea45b-kube-api-access-jc5td\") pod \"rate-test-model-7ba461-kserve-8456fd67f-c26g2\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") " pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.325573 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.325484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:17.471997 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.471967    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"]
Jul 06 20:10:17.473688 ip-10-0-140-210 kubenswrapper[2579]: W0706 20:10:17.473667    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68597350_6dce_409b_a860_2f87113ea45b.slice/crio-69b4080f383a201795f726fad6729bf2a176e102484288eb366520238f01f7de WatchSource:0}: Error finding container 69b4080f383a201795f726fad6729bf2a176e102484288eb366520238f01f7de: Status 404 returned error can't find the container with id 69b4080f383a201795f726fad6729bf2a176e102484288eb366520238f01f7de
Jul 06 20:10:17.686619 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.686576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" event={"ID":"68597350-6dce-409b-a860-2f87113ea45b","Type":"ContainerStarted","Data":"eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19"}
Jul 06 20:10:17.686619 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.686626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" event={"ID":"68597350-6dce-409b-a860-2f87113ea45b","Type":"ContainerStarted","Data":"69b4080f383a201795f726fad6729bf2a176e102484288eb366520238f01f7de"}
Jul 06 20:10:17.707482 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:17.707427    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" podStartSLOduration=1.707411475 podStartE2EDuration="1.707411475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:17.7053126 +0000 UTC m=+2707.023481766" watchObservedRunningTime="2026-07-06 20:10:17.707411475 +0000 UTC m=+2707.025580689"
Jul 06 20:10:27.326479 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:27.326451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:27.326892 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:27.326522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:27.338982 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:27.338957    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:27.686202 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:27.686136    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2" podUID="c26aca21-415c-41f9-bb70-3f1be32c2476" containerName="main" containerID="cri-o://7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381" gracePeriod=45
Jul 06 20:10:27.759793 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:27.759764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:10:27.937241 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:27.937174    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:10:28.046782 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.046751    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr62m\" (UniqueName: \"kubernetes.io/projected/c26aca21-415c-41f9-bb70-3f1be32c2476-kube-api-access-fr62m\") pod \"c26aca21-415c-41f9-bb70-3f1be32c2476\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") "
Jul 06 20:10:28.046976 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.046802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-model-cache\") pod \"c26aca21-415c-41f9-bb70-3f1be32c2476\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") "
Jul 06 20:10:28.046976 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.046825    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-tmp-dir\") pod \"c26aca21-415c-41f9-bb70-3f1be32c2476\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") "
Jul 06 20:10:28.046976 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.046864    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-dshm\") pod \"c26aca21-415c-41f9-bb70-3f1be32c2476\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") "
Jul 06 20:10:28.046976 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.046904    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-home\") pod \"c26aca21-415c-41f9-bb70-3f1be32c2476\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") "
Jul 06 20:10:28.046976 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.046925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26aca21-415c-41f9-bb70-3f1be32c2476-tls-certs\") pod \"c26aca21-415c-41f9-bb70-3f1be32c2476\" (UID: \"c26aca21-415c-41f9-bb70-3f1be32c2476\") "
Jul 06 20:10:28.047287 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.047136    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-model-cache" (OuterVolumeSpecName: "model-cache") pod "c26aca21-415c-41f9-bb70-3f1be32c2476" (UID: "c26aca21-415c-41f9-bb70-3f1be32c2476"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:28.047287 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.047169    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c26aca21-415c-41f9-bb70-3f1be32c2476" (UID: "c26aca21-415c-41f9-bb70-3f1be32c2476"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:28.047287 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.047246    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-home" (OuterVolumeSpecName: "home") pod "c26aca21-415c-41f9-bb70-3f1be32c2476" (UID: "c26aca21-415c-41f9-bb70-3f1be32c2476"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:28.047287 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.047289    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-model-cache\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:10:28.047494 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.047303    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-tmp-dir\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:10:28.049007 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.048981    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-dshm" (OuterVolumeSpecName: "dshm") pod "c26aca21-415c-41f9-bb70-3f1be32c2476" (UID: "c26aca21-415c-41f9-bb70-3f1be32c2476"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:10:28.049134 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.049016    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c26aca21-415c-41f9-bb70-3f1be32c2476-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c26aca21-415c-41f9-bb70-3f1be32c2476" (UID: "c26aca21-415c-41f9-bb70-3f1be32c2476"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:10:28.049134 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.049019    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26aca21-415c-41f9-bb70-3f1be32c2476-kube-api-access-fr62m" (OuterVolumeSpecName: "kube-api-access-fr62m") pod "c26aca21-415c-41f9-bb70-3f1be32c2476" (UID: "c26aca21-415c-41f9-bb70-3f1be32c2476"). InnerVolumeSpecName "kube-api-access-fr62m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:10:28.148173 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.148133    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-dshm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:10:28.148173 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.148169    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c26aca21-415c-41f9-bb70-3f1be32c2476-home\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:10:28.148173 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.148180    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c26aca21-415c-41f9-bb70-3f1be32c2476-tls-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:10:28.148409 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.148193    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr62m\" (UniqueName: \"kubernetes.io/projected/c26aca21-415c-41f9-bb70-3f1be32c2476-kube-api-access-fr62m\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:10:28.754868 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.754831    2579 generic.go:356] "Generic (PLEG): container finished" podID="c26aca21-415c-41f9-bb70-3f1be32c2476" containerID="7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381" exitCode=0
Jul 06 20:10:28.755395 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.754877    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"
Jul 06 20:10:28.755395 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.754918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2" event={"ID":"c26aca21-415c-41f9-bb70-3f1be32c2476","Type":"ContainerDied","Data":"7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381"}
Jul 06 20:10:28.755395 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.754958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2" event={"ID":"c26aca21-415c-41f9-bb70-3f1be32c2476","Type":"ContainerDied","Data":"81aea15bd4412f00baa455f7a6c9e3c8106deb4c7a0596c5383629d7104e1041"}
Jul 06 20:10:28.755395 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.754976    2579 scope.go:117] "RemoveContainer" containerID="7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381"
Jul 06 20:10:28.771389 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.771368    2579 scope.go:117] "RemoveContainer" containerID="7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381"
Jul 06 20:10:28.771647 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:10:28.771630    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381\": container with ID starting with 7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381 not found: ID does not exist" containerID="7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381"
Jul 06 20:10:28.771704 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.771659    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381"} err="failed to get container status \"7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381\": rpc error: code = NotFound desc = could not find container \"7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381\": container with ID starting with 7ed572e0bf35d973e4c48af5d8bac312ba02da87b45e0b46389e1336f81d2381 not found: ID does not exist"
Jul 06 20:10:28.785058 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.785032    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"]
Jul 06 20:10:28.798569 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:28.798546    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/sub-test-model-7ba461-kserve-7dbf89f9b5-tbcr2"]
Jul 06 20:10:29.251838 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:10:29.251806    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26aca21-415c-41f9-bb70-3f1be32c2476" path="/var/lib/kubelet/pods/c26aca21-415c-41f9-bb70-3f1be32c2476/volumes"
Jul 06 20:11:22.602951 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:22.602918    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"]
Jul 06 20:11:37.622527 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.622418    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" podUID="68597350-6dce-409b-a860-2f87113ea45b" containerName="main" containerID="cri-o://eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19" gracePeriod=45
Jul 06 20:11:37.749280 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.749241    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" podUID="68597350-6dce-409b-a860-2f87113ea45b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Jul 06 20:11:37.873960 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.873885    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:11:37.940709 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940676    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-home\") pod \"68597350-6dce-409b-a860-2f87113ea45b\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") "
Jul 06 20:11:37.940869 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940720    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-model-cache\") pod \"68597350-6dce-409b-a860-2f87113ea45b\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") "
Jul 06 20:11:37.940869 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940773    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-tmp-dir\") pod \"68597350-6dce-409b-a860-2f87113ea45b\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") "
Jul 06 20:11:37.940869 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc5td\" (UniqueName: \"kubernetes.io/projected/68597350-6dce-409b-a860-2f87113ea45b-kube-api-access-jc5td\") pod \"68597350-6dce-409b-a860-2f87113ea45b\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") "
Jul 06 20:11:37.941032 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940904    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68597350-6dce-409b-a860-2f87113ea45b-tls-certs\") pod \"68597350-6dce-409b-a860-2f87113ea45b\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") "
Jul 06 20:11:37.941032 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940933    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-dshm\") pod \"68597350-6dce-409b-a860-2f87113ea45b\" (UID: \"68597350-6dce-409b-a860-2f87113ea45b\") "
Jul 06 20:11:37.941032 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940982    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-home" (OuterVolumeSpecName: "home") pod "68597350-6dce-409b-a860-2f87113ea45b" (UID: "68597350-6dce-409b-a860-2f87113ea45b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:37.941032 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.940998    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-model-cache" (OuterVolumeSpecName: "model-cache") pod "68597350-6dce-409b-a860-2f87113ea45b" (UID: "68597350-6dce-409b-a860-2f87113ea45b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:37.941274 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.941128    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68597350-6dce-409b-a860-2f87113ea45b" (UID: "68597350-6dce-409b-a860-2f87113ea45b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:37.941320 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.941291    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-model-cache\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:11:37.941358 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.941325    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-tmp-dir\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:11:37.941358 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.941334    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-home\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:11:37.942983 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.942952    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-dshm" (OuterVolumeSpecName: "dshm") pod "68597350-6dce-409b-a860-2f87113ea45b" (UID: "68597350-6dce-409b-a860-2f87113ea45b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:11:37.942983 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.942954    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68597350-6dce-409b-a860-2f87113ea45b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68597350-6dce-409b-a860-2f87113ea45b" (UID: "68597350-6dce-409b-a860-2f87113ea45b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:11:37.943186 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:37.943050    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68597350-6dce-409b-a860-2f87113ea45b-kube-api-access-jc5td" (OuterVolumeSpecName: "kube-api-access-jc5td") pod "68597350-6dce-409b-a860-2f87113ea45b" (UID: "68597350-6dce-409b-a860-2f87113ea45b"). InnerVolumeSpecName "kube-api-access-jc5td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:11:38.042536 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.042499    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68597350-6dce-409b-a860-2f87113ea45b-tls-certs\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:11:38.042536 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.042528    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68597350-6dce-409b-a860-2f87113ea45b-dshm\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:11:38.042536 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.042541    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc5td\" (UniqueName: \"kubernetes.io/projected/68597350-6dce-409b-a860-2f87113ea45b-kube-api-access-jc5td\") on node \"ip-10-0-140-210.ec2.internal\" DevicePath \"\""
Jul 06 20:11:38.140603 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.140568    2579 generic.go:356] "Generic (PLEG): container finished" podID="68597350-6dce-409b-a860-2f87113ea45b" containerID="eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19" exitCode=0
Jul 06 20:11:38.140793 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.140615    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"
Jul 06 20:11:38.140793 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.140655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" event={"ID":"68597350-6dce-409b-a860-2f87113ea45b","Type":"ContainerDied","Data":"eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19"}
Jul 06 20:11:38.140793 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.140705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2" event={"ID":"68597350-6dce-409b-a860-2f87113ea45b","Type":"ContainerDied","Data":"69b4080f383a201795f726fad6729bf2a176e102484288eb366520238f01f7de"}
Jul 06 20:11:38.140793 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.140723    2579 scope.go:117] "RemoveContainer" containerID="eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19"
Jul 06 20:11:38.150349 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.150333    2579 scope.go:117] "RemoveContainer" containerID="eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19"
Jul 06 20:11:38.150625 ip-10-0-140-210 kubenswrapper[2579]: E0706 20:11:38.150607    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19\": container with ID starting with eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19 not found: ID does not exist" containerID="eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19"
Jul 06 20:11:38.150682 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.150633    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19"} err="failed to get container status \"eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19\": rpc error: code = NotFound desc = could not find container \"eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19\": container with ID starting with eb4f81ba52ef7b8bc7e364af3f12e67acc7c64fa85c020d2430184eccece1e19 not found: ID does not exist"
Jul 06 20:11:38.164035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.164012    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"]
Jul 06 20:11:38.172074 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:38.172048    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7ba461/rate-test-model-7ba461-kserve-8456fd67f-c26g2"]
Jul 06 20:11:39.251326 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:39.251295    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68597350-6dce-409b-a860-2f87113ea45b" path="/var/lib/kubelet/pods/68597350-6dce-409b-a860-2f87113ea45b/volumes"
Jul 06 20:11:52.182673 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:52.182632    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64fb6fcbc6-smll5_bd14bc5a-db77-4bee-b2d6-bd4680041931/authorino/0.log"
Jul 06 20:11:57.415700 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:57.415667    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-689c7557c-wh8mz_b5f4e274-48e4-4452-aac7-430a8bc76355/manager/1.log"
Jul 06 20:11:57.644616 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:57.644587    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dwcht_ad4f0481-d168-4170-a987-3b55ec7c2a6c/manager/1.log"
Jul 06 20:11:57.759469 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:57.759386    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-647c8_07221883-95a2-47e6-b374-f979d64c2804/manager/0.log"
Jul 06 20:11:57.769075 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:57.769050    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-647c8_07221883-95a2-47e6-b374-f979d64c2804/copy-manifests/0.log"
Jul 06 20:11:58.131492 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:58.131471    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-x4bc6_4dc186e7-740b-460f-bc7b-c0dc8393a23e/postgres/0.log"
Jul 06 20:11:58.891923 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:58.891894    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh_bae039ba-6b36-4878-b6d9-e34cccc5cbfa/util/0.log"
Jul 06 20:11:58.898670 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:58.898652    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh_bae039ba-6b36-4878-b6d9-e34cccc5cbfa/pull/0.log"
Jul 06 20:11:58.905019 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:58.905001    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh_bae039ba-6b36-4878-b6d9-e34cccc5cbfa/extract/0.log"
Jul 06 20:11:59.021769 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.021740    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6_546307ac-c6be-4a2d-8d37-97e89a1b214d/util/0.log"
Jul 06 20:11:59.029040 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.029020    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6_546307ac-c6be-4a2d-8d37-97e89a1b214d/pull/0.log"
Jul 06 20:11:59.036720 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.036686    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6_546307ac-c6be-4a2d-8d37-97e89a1b214d/extract/0.log"
Jul 06 20:11:59.147356 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.147263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5_8c59fa2c-697d-402f-93d6-8eac38dd3849/pull/0.log"
Jul 06 20:11:59.154207 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.154180    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5_8c59fa2c-697d-402f-93d6-8eac38dd3849/extract/0.log"
Jul 06 20:11:59.160452 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.160437    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5_8c59fa2c-697d-402f-93d6-8eac38dd3849/util/0.log"
Jul 06 20:11:59.271050 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.271022    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2_91eb56bb-809e-4dd0-8eea-343bd1cedb91/util/0.log"
Jul 06 20:11:59.278533 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.278512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2_91eb56bb-809e-4dd0-8eea-343bd1cedb91/pull/0.log"
Jul 06 20:11:59.285151 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.285097    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2_91eb56bb-809e-4dd0-8eea-343bd1cedb91/extract/0.log"
Jul 06 20:11:59.401117 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.401003    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64fb6fcbc6-smll5_bd14bc5a-db77-4bee-b2d6-bd4680041931/authorino/0.log"
Jul 06 20:11:59.517285 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.517248    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9gw7x_816de7e1-87f7-460b-88c9-6829427561cf/manager/1.log"
Jul 06 20:11:59.850213 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:11:59.850141    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fqmpd_98fdd54a-7641-4f68-9930-c87d53abe370/registry-server/0.log"
Jul 06 20:12:00.215763 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:00.215734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t9jpj_8c0e2394-1317-4758-8c50-e702df02dcca/manager/1.log"
Jul 06 20:12:00.685538 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:00.685512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2kf7h_1990d0fe-cc71-4c8b-9c4e-8e6237a314b3/discovery/0.log"
Jul 06 20:12:00.900586 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:00.900558    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-jnl9w_bc3c89ed-73f2-48d7-bffe-a6754da541e0/kube-auth-proxy/0.log"
Jul 06 20:12:01.277150 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:01.277116    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-96tzh_8e500e1e-4165-4f22-85b5-ed539296a390/payload-processing/0.log"
Jul 06 20:12:01.736952 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:01.736896    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6ftfd_0e4c3f59-6e65-4682-b79d-19157c84b729/main/0.log"
Jul 06 20:12:01.966029 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:01.965999    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fld6h_00072233-bd0d-4a5a-8803-4b6f40b9b3bd/main/0.log"
Jul 06 20:12:02.182947 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:02.182917    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ql9c4_56f74e96-4e2a-41fb-98d6-3ab5a18c8e95/main/0.log"
Jul 06 20:12:09.174477 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:09.174443    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nvlc7_a71f9c61-120c-4405-9649-feccff6b0788/global-pull-secret-syncer/0.log"
Jul 06 20:12:09.313376 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:09.313348    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gcxfv_0c42c5ec-84bd-4a0c-9131-1e45c47e6bd8/konnectivity-agent/0.log"
Jul 06 20:12:09.422496 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:09.422469    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-210.ec2.internal_651cad9dd4ffeaa969a97ffb85ed2c95/haproxy/0.log"
Jul 06 20:12:13.720789 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.720754    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh_bae039ba-6b36-4878-b6d9-e34cccc5cbfa/extract/0.log"
Jul 06 20:12:13.744929 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.744901    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh_bae039ba-6b36-4878-b6d9-e34cccc5cbfa/util/0.log"
Jul 06 20:12:13.767910 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.767883    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xk6nh_bae039ba-6b36-4878-b6d9-e34cccc5cbfa/pull/0.log"
Jul 06 20:12:13.799565 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.799543    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6_546307ac-c6be-4a2d-8d37-97e89a1b214d/extract/0.log"
Jul 06 20:12:13.819477 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.819456    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6_546307ac-c6be-4a2d-8d37-97e89a1b214d/util/0.log"
Jul 06 20:12:13.841289 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.841270    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0z5bb6_546307ac-c6be-4a2d-8d37-97e89a1b214d/pull/0.log"
Jul 06 20:12:13.873977 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.873953    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5_8c59fa2c-697d-402f-93d6-8eac38dd3849/extract/0.log"
Jul 06 20:12:13.897174 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.897151    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5_8c59fa2c-697d-402f-93d6-8eac38dd3849/util/0.log"
Jul 06 20:12:13.920497 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.920479    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hq8w5_8c59fa2c-697d-402f-93d6-8eac38dd3849/pull/0.log"
Jul 06 20:12:13.946068 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.946032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2_91eb56bb-809e-4dd0-8eea-343bd1cedb91/extract/0.log"
Jul 06 20:12:13.970458 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.970439    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2_91eb56bb-809e-4dd0-8eea-343bd1cedb91/util/0.log"
Jul 06 20:12:13.992036 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:13.991986    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g8pz2_91eb56bb-809e-4dd0-8eea-343bd1cedb91/pull/0.log"
Jul 06 20:12:14.283441 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:14.283354    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64fb6fcbc6-smll5_bd14bc5a-db77-4bee-b2d6-bd4680041931/authorino/0.log"
Jul 06 20:12:14.310550 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:14.310524    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9gw7x_816de7e1-87f7-460b-88c9-6829427561cf/manager/1.log"
Jul 06 20:12:14.312876 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:14.312834    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9gw7x_816de7e1-87f7-460b-88c9-6829427561cf/manager/0.log"
Jul 06 20:12:14.421390 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:14.421361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fqmpd_98fdd54a-7641-4f68-9930-c87d53abe370/registry-server/0.log"
Jul 06 20:12:14.679895 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:14.679857    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t9jpj_8c0e2394-1317-4758-8c50-e702df02dcca/manager/1.log"
Jul 06 20:12:14.695554 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:14.695532    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-t9jpj_8c0e2394-1317-4758-8c50-e702df02dcca/manager/0.log"
Jul 06 20:12:16.825164 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:16.825142    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54b5949b66-9spvn_cb842bee-f45c-4218-9edb-25ccd3939802/metrics-server/0.log"
Jul 06 20:12:16.874199 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:16.874173    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-kzngc_4203a4e6-7b85-41ef-a354-0aed7da7af8d/monitoring-plugin/0.log"
Jul 06 20:12:17.137943 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.137919    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbvnm_e38562d3-6be4-46a2-af41-149365fa30e7/node-exporter/0.log"
Jul 06 20:12:17.168357 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.168337    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbvnm_e38562d3-6be4-46a2-af41-149365fa30e7/kube-rbac-proxy/0.log"
Jul 06 20:12:17.194706 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.194680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbvnm_e38562d3-6be4-46a2-af41-149365fa30e7/init-textfile/0.log"
Jul 06 20:12:17.224672 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.224650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-72nd5_b57132de-f3dd-4216-afa0-9f9277adb5e8/kube-rbac-proxy-main/0.log"
Jul 06 20:12:17.249052 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.249025    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-72nd5_b57132de-f3dd-4216-afa0-9f9277adb5e8/kube-rbac-proxy-self/0.log"
Jul 06 20:12:17.274882 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.274846    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-72nd5_b57132de-f3dd-4216-afa0-9f9277adb5e8/openshift-state-metrics/0.log"
Jul 06 20:12:17.581739 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.581660    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-gh4vz_4b280768-634c-4cae-bb86-b25b273909d6/prometheus-operator-admission-webhook/0.log"
Jul 06 20:12:17.709100 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.709072    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c7956-zzwk7_79fb4f3a-85c1-4b10-9287-516d9dead414/thanos-query/0.log"
Jul 06 20:12:17.730886 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.730844    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c7956-zzwk7_79fb4f3a-85c1-4b10-9287-516d9dead414/kube-rbac-proxy-web/0.log"
Jul 06 20:12:17.754940 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.754915    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c7956-zzwk7_79fb4f3a-85c1-4b10-9287-516d9dead414/kube-rbac-proxy/0.log"
Jul 06 20:12:17.776556 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.776530    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c7956-zzwk7_79fb4f3a-85c1-4b10-9287-516d9dead414/prom-label-proxy/0.log"
Jul 06 20:12:17.798646 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.798626    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c7956-zzwk7_79fb4f3a-85c1-4b10-9287-516d9dead414/kube-rbac-proxy-rules/0.log"
Jul 06 20:12:17.827723 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:17.827702    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866c7956-zzwk7_79fb4f3a-85c1-4b10-9287-516d9dead414/kube-rbac-proxy-metrics/0.log"
Jul 06 20:12:19.409543 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.409511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"]
Jul 06 20:12:19.410035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.409885    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26aca21-415c-41f9-bb70-3f1be32c2476" containerName="main"
Jul 06 20:12:19.410035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.409901    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26aca21-415c-41f9-bb70-3f1be32c2476" containerName="main"
Jul 06 20:12:19.410035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.409917    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68597350-6dce-409b-a860-2f87113ea45b" containerName="main"
Jul 06 20:12:19.410035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.409923    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="68597350-6dce-409b-a860-2f87113ea45b" containerName="main"
Jul 06 20:12:19.410035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.409993    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="68597350-6dce-409b-a860-2f87113ea45b" containerName="main"
Jul 06 20:12:19.410035 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.410001    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26aca21-415c-41f9-bb70-3f1be32c2476" containerName="main"
Jul 06 20:12:19.413163 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.413143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.415737 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.415716    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nfpj8\"/\"kube-root-ca.crt\""
Jul 06 20:12:19.416525 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.416509    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nfpj8\"/\"default-dockercfg-jjzk2\""
Jul 06 20:12:19.416596 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.416532    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nfpj8\"/\"openshift-service-ca.crt\""
Jul 06 20:12:19.421495 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.421473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"]
Jul 06 20:12:19.495327 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.495285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-podres\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.495488 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.495339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68kdq\" (UniqueName: \"kubernetes.io/projected/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-kube-api-access-68kdq\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.495488 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.495414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-lib-modules\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.495488 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.495478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-proc\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.495599 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.495517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-sys\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596442 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-podres\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68kdq\" (UniqueName: \"kubernetes.io/projected/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-kube-api-access-68kdq\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-lib-modules\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-proc\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596560    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-podres\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-sys\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596630 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596608    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-proc\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596865 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596639    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-lib-modules\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.596865 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.596675    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-sys\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.605687 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.605664    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68kdq\" (UniqueName: \"kubernetes.io/projected/a2d1e058-f4b8-45d8-87d0-677f5b2784aa-kube-api-access-68kdq\") pod \"perf-node-gather-daemonset-6bdwk\" (UID: \"a2d1e058-f4b8-45d8-87d0-677f5b2784aa\") " pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.724824 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.724726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:19.864690 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:19.864663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"]
Jul 06 20:12:19.867221 ip-10-0-140-210 kubenswrapper[2579]: W0706 20:12:19.867187    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2d1e058_f4b8_45d8_87d0_677f5b2784aa.slice/crio-93a3984ed480b2743c915296c45d1be98133345e3ba5f9aaf0b6d8a245365aa8 WatchSource:0}: Error finding container 93a3984ed480b2743c915296c45d1be98133345e3ba5f9aaf0b6d8a245365aa8: Status 404 returned error can't find the container with id 93a3984ed480b2743c915296c45d1be98133345e3ba5f9aaf0b6d8a245365aa8
Jul 06 20:12:20.373390 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:20.373354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk" event={"ID":"a2d1e058-f4b8-45d8-87d0-677f5b2784aa","Type":"ContainerStarted","Data":"837c63c83316847069c05218ce59abc4c807810ea637f669a84e499190a730f6"}
Jul 06 20:12:20.373572 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:20.373412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk" event={"ID":"a2d1e058-f4b8-45d8-87d0-677f5b2784aa","Type":"ContainerStarted","Data":"93a3984ed480b2743c915296c45d1be98133345e3ba5f9aaf0b6d8a245365aa8"}
Jul 06 20:12:20.373572 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:20.373500    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:20.391451 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:20.391405    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk" podStartSLOduration=1.391390234 podStartE2EDuration="1.391390234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:12:20.389527993 +0000 UTC m=+2829.707697160" watchObservedRunningTime="2026-07-06 20:12:20.391390234 +0000 UTC m=+2829.709559399"
Jul 06 20:12:21.907836 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:21.907802    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dkmb4_2255317d-b290-4f95-9383-34c3606cf66d/dns/0.log"
Jul 06 20:12:21.930891 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:21.930862    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dkmb4_2255317d-b290-4f95-9383-34c3606cf66d/kube-rbac-proxy/0.log"
Jul 06 20:12:22.007420 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:22.007392    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8d85z_0c20cd12-3105-4c82-bc50-58ae5c0efdd5/dns-node-resolver/0.log"
Jul 06 20:12:22.593154 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:22.593121    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5df77dbcc5-bjnsb_fb2262ce-1c5f-4682-90ce-0a2ae431713d/registry/0.log"
Jul 06 20:12:22.655278 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:22.655250    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hkqwx_86827bda-61c7-4fa9-a6d9-b04bb61c59e4/node-ca/0.log"
Jul 06 20:12:23.744609 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:23.744578    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2kf7h_1990d0fe-cc71-4c8b-9c4e-8e6237a314b3/discovery/0.log"
Jul 06 20:12:23.790023 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:23.789997    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-jnl9w_bc3c89ed-73f2-48d7-bffe-a6754da541e0/kube-auth-proxy/0.log"
Jul 06 20:12:23.941087 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:23.941058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-96tzh_8e500e1e-4165-4f22-85b5-ed539296a390/payload-processing/0.log"
Jul 06 20:12:24.695493 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:24.695462    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lzvlh_9f04c054-8605-497e-85dd-1a6136b6bdd4/serve-healthcheck-canary/0.log"
Jul 06 20:12:25.278932 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:25.278907    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttpzg_eb052699-8ada-4f93-992a-72ccf571ee2e/kube-rbac-proxy/0.log"
Jul 06 20:12:25.311618 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:25.311591    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttpzg_eb052699-8ada-4f93-992a-72ccf571ee2e/exporter/0.log"
Jul 06 20:12:25.337487 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:25.337459    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttpzg_eb052699-8ada-4f93-992a-72ccf571ee2e/extractor/0.log"
Jul 06 20:12:26.388407 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:26.388381    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nfpj8/perf-node-gather-daemonset-6bdwk"
Jul 06 20:12:27.852909 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:27.852881    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-689c7557c-wh8mz_b5f4e274-48e4-4452-aac7-430a8bc76355/manager/1.log"
Jul 06 20:12:27.883971 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:27.883945    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-689c7557c-wh8mz_b5f4e274-48e4-4452-aac7-430a8bc76355/manager/0.log"
Jul 06 20:12:27.968401 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:27.968375    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dwcht_ad4f0481-d168-4170-a987-3b55ec7c2a6c/manager/1.log"
Jul 06 20:12:27.985286 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:27.985257    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dwcht_ad4f0481-d168-4170-a987-3b55ec7c2a6c/manager/0.log"
Jul 06 20:12:28.011607 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:28.011585    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-647c8_07221883-95a2-47e6-b374-f979d64c2804/manager/0.log"
Jul 06 20:12:28.035269 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:28.035247    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-849ccdb5-647c8_07221883-95a2-47e6-b374-f979d64c2804/copy-manifests/0.log"
Jul 06 20:12:28.254122 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:28.254060    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-x4bc6_4dc186e7-740b-460f-bc7b-c0dc8393a23e/postgres/0.log"
Jul 06 20:12:29.636010 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:29.635980    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2kf7h_1990d0fe-cc71-4c8b-9c4e-8e6237a314b3/discovery/0.log"
Jul 06 20:12:29.664299 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:29.664279    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-jnl9w_bc3c89ed-73f2-48d7-bffe-a6754da541e0/kube-auth-proxy/0.log"
Jul 06 20:12:29.784883 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:29.784855    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-96tzh_8e500e1e-4165-4f22-85b5-ed539296a390/payload-processing/0.log"
Jul 06 20:12:31.090757 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:31.090728    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2kf7h_1990d0fe-cc71-4c8b-9c4e-8e6237a314b3/discovery/0.log"
Jul 06 20:12:31.119537 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:31.119509    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6568d8f747-jnl9w_bc3c89ed-73f2-48d7-bffe-a6754da541e0/kube-auth-proxy/0.log"
Jul 06 20:12:31.256936 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:31.256906    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-96tzh_8e500e1e-4165-4f22-85b5-ed539296a390/payload-processing/0.log"
Jul 06 20:12:36.308099 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.308070    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/kube-multus-additional-cni-plugins/0.log"
Jul 06 20:12:36.329525 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.329498    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/egress-router-binary-copy/0.log"
Jul 06 20:12:36.351216 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.351191    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/cni-plugins/0.log"
Jul 06 20:12:36.372507 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.372480    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/bond-cni-plugin/0.log"
Jul 06 20:12:36.393759 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.393735    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/routeoverride-cni/0.log"
Jul 06 20:12:36.414577 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.414552    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/whereabouts-cni-bincopy/0.log"
Jul 06 20:12:36.438774 ip-10-0-140-210 kubenswrapper[2579]: I0706 20:12:36.438751    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rz49b_7c7ca5a5-a639-40fa-a950-cfbb060c9ad4/whereabouts-cni/0.log"