Jul 21 04:07:18.494512 ip-10-0-134-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 04:07:18.494523 ip-10-0-134-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 04:07:18.494532 ip-10-0-134-95 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 04:07:18.494851 ip-10-0-134-95 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 04:07:28.515208 ip-10-0-134-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 04:07:28.515228 ip-10-0-134-95 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2517d2f3adf04716842d6cbb94e1f108 --
Jul 21 04:09:18.828022 ip-10-0-134-95 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 04:09:19.139202 ip-10-0-134-95 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:09:19.139202 ip-10-0-134-95 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 04:09:19.139202 ip-10-0-134-95 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:09:19.139202 ip-10-0-134-95 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 04:09:19.139202 ip-10-0-134-95 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 04:09:19.139952 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.139858    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 04:09:19.143714 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143682    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:09:19.143714 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143703    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143719    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143724    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143728    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143731    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143734    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143737    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143740    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143743    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143746    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143749    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143755    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143758    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143761    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143764    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143766    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143769    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143772    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143775    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143777    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:09:19.143787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143780    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143783    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143785    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143788    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143791    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143794    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143797    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143801    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143806    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143809    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143812    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143814    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143817    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143819    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143822    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143824    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143827    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143829    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143832    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143835    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:09:19.144250 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143837    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143840    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143842    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143845    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143848    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143850    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143853    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143855    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143859    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143861    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143864    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143867    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143870    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143872    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143876    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143878    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143881    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143883    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143886    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:09:19.144863 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143889    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143891    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143893    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143896    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143899    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143901    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143904    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143906    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143909    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143911    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143914    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143916    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143919    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143921    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143924    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143928    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143931    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143935    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143938    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:09:19.145611 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143941    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143944    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143947    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143950    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143954    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143956    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143959    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143962    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143965    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143968    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143971    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143974    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143977    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143979    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143982    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143985    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143987    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143990    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143992    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.143996    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:09:19.146246 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.145923    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.145946    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146014    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146023    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146032    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146038    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146044    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146617    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146633    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146637    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146640    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146643    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146646    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146648    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146651    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146654    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146657    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146659    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146664    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:09:19.146777 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146669    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146673    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146676    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146680    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146685    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146688    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146691    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146693    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146696    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146698    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146701    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146720    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146725    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146727    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146730    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146732    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146735    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146738    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146741    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:09:19.147253 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146745    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146750    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146755    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146758    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146761    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146764    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146767    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146770    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146772    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146775    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146777    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146780    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146783    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146786    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146789    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146791    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146794    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146797    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146800    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146802    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:09:19.147723 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146805    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146808    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146810    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146813    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146816    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146818    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146821    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146823    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146826    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146828    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146831    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146833    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146836    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146839    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146844    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146846    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146849    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146852    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146855    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146857    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:09:19.148197 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146860    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146863    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146865    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146870    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146873    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146876    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146879    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146882    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146885    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146888    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146890    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146893    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146896    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146898    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146901    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146903    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146906    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146908    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146911    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:09:19.148809 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146914    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.146916    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147338    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147344    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147347    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147350    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147353    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147357    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147360    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147362    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147365    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147368    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147370    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147373    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147375    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147378    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147381    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147384    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147386    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147389    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:09:19.149261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147392    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147395    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147397    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147400    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147402    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147405    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147407    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147410    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147412    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147415    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147418    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147421    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147423    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147426    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147428    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147431    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147434    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147436    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147439    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147442    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:09:19.149763 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147445    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147448    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147452    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147456    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147459    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147462    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147465    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147468    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147470    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147473    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147476    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147484    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147487    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147489    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147492    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147494    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147497    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147499    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147501    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:09:19.150244 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147504    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147506    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147509    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147511    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147513    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147516    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147518    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147521    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147524    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147526    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147529    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147532    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147535    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147539    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147542    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147544    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147548    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147552    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147554    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:09:19.150691 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147557    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147559    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147562    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147564    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147567    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147569    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147577    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147580    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147583    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147586    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147588    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147591    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147595    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147598    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147600    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147603    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147605    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147608    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147610    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:09:19.151188 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147613    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147615    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147618    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.147620    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147697    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147720    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147735    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147740    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147745    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147749    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147753    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147757    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147760    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147763    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147767    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147770    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147773    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147776    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147779    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147782    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147791    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147794    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147801    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147804    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 04:09:19.151640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147807    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147810    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147814    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147817    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147820    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147823    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147827    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147831    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147834    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147837    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147840    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147842    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147847    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147850    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147853    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147856    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147860    2567 flags.go:64] FLAG: --enable-server="true"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147863    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147870    2567 flags.go:64] FLAG: --event-burst="100"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147873    2567 flags.go:64] FLAG: --event-qps="50"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147876    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147879    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147881    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147885    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 04:09:19.152223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147888    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147891    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147894    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147897    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147900    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147908    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147911    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147914    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147917    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147920    2567 flags.go:64] FLAG: --feature-gates=""
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147923    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147926    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147929    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147932    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147935    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147938    2567 flags.go:64] FLAG: --help="false"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147940    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147943    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147946    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147949    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147952    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147956    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147959    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 04:09:19.152843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147961    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147964    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147968    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147970    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147974    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147976    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147979    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147982    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147985    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147988    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147991    2567 flags.go:64] FLAG: --lock-file=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147993    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147996    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.147999    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148005    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148013    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148016    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148019    2567 flags.go:64] FLAG: --logging-format="text"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148022    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148025    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148028    2567 flags.go:64] FLAG: --manifest-url=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148031    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148036    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148039    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148043    2567 flags.go:64] FLAG: --max-pods="110"
Jul 21 04:09:19.153418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148046    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148049    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148052    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148055    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148058    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148061    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148064    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148071    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148074    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148077    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148080    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148083    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148088    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148091    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148094    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148097    2567 flags.go:64] FLAG: --port="10250"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148099    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148102    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b40b5b870f77fb56"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148105    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148108    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148111    2567 flags.go:64] FLAG: --register-node="true"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148114    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148117    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148126    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 21 04:09:19.154054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148129    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148135    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148138    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148141    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148144    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148151    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148154    2567 flags.go:64] FLAG: --runonce="false"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148157    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148160    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148163    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148166    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148169    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148176    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148180    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148183    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148186    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148189    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148192    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148195    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148198    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148201    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148204    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148209    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148212    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148215    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 04:09:19.154862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148222    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148225    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148228    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148231    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148234    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148237    2567 flags.go:64] FLAG: --v="2"
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148241    2567 flags.go:64] FLAG: --version="false"
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148250    2567 flags.go:64] FLAG: --vmodule=""
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148255    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.148258    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148381    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148385    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148390    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148393    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148396    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148399    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148402    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148404    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148406    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148410    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148415    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:09:19.155917 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148419    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148422    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148424    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148427    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148429    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148432    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148434    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148437    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148440    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148442    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148445    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148448    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148450    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148453    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148456    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148459    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148461    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148464    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148466    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:09:19.156813 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148476    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148478    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148481    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148483    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148487    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148490    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148492    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148495    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148497    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148500    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148503    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148507    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148510    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148512    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148515    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148517    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148520    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148522    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148525    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148528    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:09:19.157348 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148530    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148532    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148535    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148538    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148540    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148543    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148546    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148548    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148550    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148553    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148555    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148558    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148560    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148569    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148572    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148574    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148578    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148581    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148584    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148586    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:09:19.158202 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148589    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148593    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148596    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148601    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148604    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148606    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148610    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148612    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148615    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148618    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148620    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148623    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148626    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148628    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148631    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148634    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148636    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148639    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148641    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148644    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:09:19.159067 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148646    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148649    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148651    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148654    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148656    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148660    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148669    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148673    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.148677    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.149221    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.156888    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.156912    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.157558    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.157570    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 04:09:19.159645 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157671    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157680    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157685    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157690    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157694    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157699    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157723    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157728    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157732    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157736    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157739    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157743    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157747    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157751    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157755    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157759    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157763    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157767    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157771    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157775    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:09:19.160236 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157779    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157783    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157787    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157791    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157795    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157800    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157803    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157808    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157812    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157819    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157823    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157827    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157831    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157836    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157840    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157844    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157849    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157853    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157857    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157861    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:09:19.161081 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157865    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157870    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157874    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157879    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157883    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157887    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157894    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157900    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157904    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157909    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157913    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157917    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157922    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157926    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157930    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157935    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157939    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157943    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157948    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157953    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:09:19.161614 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157958    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157962    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157968    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157972    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157976    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157981    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157985    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157989    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157994    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.157998    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158002    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158007    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158011    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158015    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158019    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158023    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158028    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158032    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158036    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:09:19.162273 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158041    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158045    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158049    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158054    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158058    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158062    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158067    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158071    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158077    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158083    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158088    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158093    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158106    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158111    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158116    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158120    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158125    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158132    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158137    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:09:19.162884 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158142    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.158150    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158349    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158359    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158365    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158369    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158374    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158379    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158384    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158388    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158392    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158397    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158402    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158407    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158411    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 04:09:19.163408 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158417    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158421    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158425    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158430    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158435    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158439    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158444    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158448    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158453    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158457    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158462    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158466    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158470    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158475    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158479    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158485    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158489    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158494    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158498    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158502    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 04:09:19.163811 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158506    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158510    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158515    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158519    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158523    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158527    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158532    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158538    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158544    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158549    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158554    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158558    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158563    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158567    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158571    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158576    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158580    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158584    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158589    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 04:09:19.164319 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158593    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158598    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158603    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158610    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158616    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158621    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158627    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158631    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158636    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158641    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158646    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158650    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158654    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158658    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158662    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158667    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158671    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158675    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158680    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 04:09:19.164851 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158684    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158688    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158692    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158696    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158700    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158720    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158724    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158729    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158733    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158738    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158743    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158747    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158751    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158756    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158759    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158764    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158769    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158775    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158781    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 04:09:19.165334 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158786    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158790    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158795    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158799    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158805    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158809    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158813    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158818    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:19.158822    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.158831    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.159043    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.162513    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.163789    2567 server.go:1019] "Starting client certificate rotation"
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.163898    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:09:19.166143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.163941    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 04:09:19.166719 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.166244    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:09:19.167638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.167618    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 04:09:19.176550 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.176525    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 21 04:09:19.178763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.178747    2567 log.go:25] "Validated CRI v1 image API"
Jul 21 04:09:19.179628 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.179611    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 04:09:19.182201 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.182174    2567 fs.go:135] Filesystem UUIDs: map[261a793d-138e-4ea2-8f2b-3f90a87c9987:/dev/nvme0n1p4 3ac2c529-882f-4336-90a1-2288176feec4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 21 04:09:19.182298 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.182198    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 04:09:19.185674 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.185638    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:09:19.187924 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.187803    2567 manager.go:216] Machine: {Timestamp:2026-07-21 04:09:19.186096942 +0000 UTC m=+0.263321279 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088590 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec284709a82fa90622a21fd06544aa1e SystemUUID:ec284709-a82f-a906-22a2-1fd06544aa1e BootID:2517d2f3-adf0-4716-842d-6cbb94e1f108 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:23:67:c7:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:23:67:c7:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:60:c0:a7:30:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 04:09:19.187924 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.187915    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 04:09:19.188126 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.188015    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 04:09:19.190682 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.190652    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 04:09:19.190874 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.190687    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 04:09:19.191378 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.191366    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 04:09:19.191441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.191384    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 04:09:19.191441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.191394    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:09:19.191441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.191414    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 04:09:19.192610 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.192597    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 04:09:19.196448 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196432    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:09:19.196598 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196586    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 04:09:19.196671 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196627    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 04:09:19.196671 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196643    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 04:09:19.196671 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196663    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 04:09:19.196802 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196676    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 21 04:09:19.196802 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.196691    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 04:09:19.197129 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.197115    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:09:19.197191 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.197139    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 04:09:19.199395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.199376    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 04:09:19.201135 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.201102    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 04:09:19.201197 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.201151    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 04:09:19.202241 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202228    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 04:09:19.202305 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202246    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 04:09:19.202305 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202253    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 04:09:19.202305 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202268    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 04:09:19.202305 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202283    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 04:09:19.202305 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202292    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 04:09:19.202446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202312    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 04:09:19.202446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202320    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 04:09:19.202446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202329    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 04:09:19.202446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202337    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 04:09:19.202446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202349    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 04:09:19.202446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202361    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 04:09:19.202989 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.202976    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 04:09:19.203029 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.203002    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 04:09:19.205360 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.205325    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 04:09:19.205910 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.205888    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 04:09:19.205956 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.205894    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 04:09:19.206275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.206263    2567 server.go:1268] "Started kubelet"
Jul 21 04:09:19.206394 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.206353    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 04:09:19.206490 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.206448    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 04:09:19.206598 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.206570    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 04:09:19.207174 ip-10-0-134-95 systemd[1]: Started Kubernetes Kubelet.
Jul 21 04:09:19.209845 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.209822    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 04:09:19.210801 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.210779    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 04:09:19.213352 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.213322    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvmzv"
Jul 21 04:09:19.214223 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.214201    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 04:09:19.217122 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217101    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 04:09:19.217122 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217116    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 04:09:19.217324 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.217247    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.217659 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217642    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 04:09:19.217752 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217700    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 04:09:19.217752 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217731    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 04:09:19.217895 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217874    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 04:09:19.217895 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.217894    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 04:09:19.218241 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218225    2567 factory.go:55] Registering systemd factory
Jul 21 04:09:19.218291 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218267    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 21 04:09:19.218524 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218508    2567 factory.go:153] Registering CRI-O factory
Jul 21 04:09:19.218524 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218526    2567 factory.go:223] Registration of the crio container factory successfully
Jul 21 04:09:19.218656 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218579    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 04:09:19.218656 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218603    2567 factory.go:103] Registering Raw factory
Jul 21 04:09:19.218656 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.218617    2567 manager.go:1196] Started watching for new ooms in manager
Jul 21 04:09:19.219043 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.219027    2567 manager.go:349] Starting recovery of all containers
Jul 21 04:09:19.219266 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.219244    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bvmzv"
Jul 21 04:09:19.227038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.227010    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:09:19.231515 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.231484    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-95.ec2.internal\" not found" node="ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.232141 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.232123    2567 manager.go:354] Recovery completed
Jul 21 04:09:19.236385 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.236367    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.238339 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238308    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.238429 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238351    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.238429 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238365    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.238948 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238931    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 04:09:19.238948 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238944    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 04:09:19.239051 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238964    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.239051 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.238989    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 04:09:19.239698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.239684    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.239786 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.239736    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.239786 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.239751    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.241086 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.241070    2567 policy_none.go:49] "None policy: Start"
Jul 21 04:09:19.241131 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.241090    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 04:09:19.241131 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.241101    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 04:09:19.243152 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.243138    2567 policy_none.go:47] "Start"
Jul 21 04:09:19.282660 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.282461    2567 manager.go:337] "Starting Device Plugin manager"
Jul 21 04:09:19.282834 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.282679    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 04:09:19.282834 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.282690    2567 server.go:87] "Starting device plugin registration server"
Jul 21 04:09:19.282972 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.282960    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 04:09:19.283026 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.282973    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 04:09:19.283111 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.283085    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 04:09:19.283223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.283206    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 04:09:19.283223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.283218    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 04:09:19.283859 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.283841    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 04:09:19.283936 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.283888    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.350090 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.350056    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 04:09:19.352354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.351242    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 04:09:19.352354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.351288    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 04:09:19.352354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.351322    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 04:09:19.352354 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.351362    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 04:09:19.353631 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.353612    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:09:19.383647 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.383595    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.384658 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.384635    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.384799 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.384670    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.384799 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.384685    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.384799 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.384730    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.393667 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.393602    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.393667 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.393632    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-95.ec2.internal\": node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.407187 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.407157    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.452234 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.452199    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"]
Jul 21 04:09:19.452359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.452293    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.453250 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.453232    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.453404 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.453267    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.453404 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.453280    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.455657 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.455641    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.455782 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.455767    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.455837 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.455799    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.456420 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.456406    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.456420 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.456417    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.456545 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.456437    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.456545 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.456436    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.456545 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.456460    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.456545 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.456447    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.458812 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.458797    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.458881 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.458822    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 04:09:19.459595 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.459582    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 04:09:19.459650 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.459603    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 04:09:19.459650 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.459612    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeHasSufficientPID"
Jul 21 04:09:19.473446 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.473420    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-95.ec2.internal\" not found" node="ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.476937 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.476918    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-95.ec2.internal\" not found" node="ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.508306 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.508275    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.518866 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.518831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4eee650cb360f6091758c87e5c6ae938-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"4eee650cb360f6091758c87e5c6ae938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.518866 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.518868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eee650cb360f6091758c87e5c6ae938-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"4eee650cb360f6091758c87e5c6ae938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.519046 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.518898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5967dca527be5168794214a27e6630c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-95.ec2.internal\" (UID: \"5967dca527be5168794214a27e6630c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.609527 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.609481    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.619289 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.619263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eee650cb360f6091758c87e5c6ae938-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"4eee650cb360f6091758c87e5c6ae938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.619441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.619339    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5967dca527be5168794214a27e6630c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-95.ec2.internal\" (UID: \"5967dca527be5168794214a27e6630c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.619441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.619375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5967dca527be5168794214a27e6630c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-95.ec2.internal\" (UID: \"5967dca527be5168794214a27e6630c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.619441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.619388    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eee650cb360f6091758c87e5c6ae938-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"4eee650cb360f6091758c87e5c6ae938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.619441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.619417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4eee650cb360f6091758c87e5c6ae938-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"4eee650cb360f6091758c87e5c6ae938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.619597 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.619453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4eee650cb360f6091758c87e5c6ae938-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal\" (UID: \"4eee650cb360f6091758c87e5c6ae938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.709953 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.709873    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.779667 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.779637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.779825 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:19.779637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:19.810565 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.810527    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:19.913333 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:19.913271    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:20.013823 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:20.013697    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:20.114408 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:20.114370    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:20.164813 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.164769    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 04:09:20.165321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.164971    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:09:20.165321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.165007    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 04:09:20.214609 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:20.214570    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-95.ec2.internal\" not found"
Jul 21 04:09:20.225073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.225024    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 04:04:20 +0000 UTC" deadline="2027-12-28 16:35:18.124913205 +0000 UTC"
Jul 21 04:09:20.225073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.225065    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12612h25m57.899852023s"
Jul 21 04:09:20.286772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.286672    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:09:20.318061 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.318025    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:20.330426 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.330392    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:09:20.331930 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.331904    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal"
Jul 21 04:09:20.339347 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.339322    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 04:09:20.414014 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:20.413981    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5967dca527be5168794214a27e6630c4.slice/crio-18a76c57bf089ae4b54dac4ecbd2b5285f87cae4b35975890b0b0d2b41f2971a WatchSource:0}: Error finding container 18a76c57bf089ae4b54dac4ecbd2b5285f87cae4b35975890b0b0d2b41f2971a: Status 404 returned error can't find the container with id 18a76c57bf089ae4b54dac4ecbd2b5285f87cae4b35975890b0b0d2b41f2971a
Jul 21 04:09:20.418881 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.418859    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:09:20.426767 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:20.426738    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eee650cb360f6091758c87e5c6ae938.slice/crio-6a33b4b4974335756c837409362ade0fa1d764f051c74fa79cec6b43b05bf311 WatchSource:0}: Error finding container 6a33b4b4974335756c837409362ade0fa1d764f051c74fa79cec6b43b05bf311: Status 404 returned error can't find the container with id 6a33b4b4974335756c837409362ade0fa1d764f051c74fa79cec6b43b05bf311
Jul 21 04:09:20.794299 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.794267    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:09:20.990180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:20.989958    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:09:21.198205 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.198168    2567 apiserver.go:52] "Watching apiserver"
Jul 21 04:09:21.205281 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.205256    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 04:09:21.205774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.205727    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-bdsg9","openshift-network-operator/iptables-alerter-q5cn7","kube-system/global-pull-secret-syncer-fdtdh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2","openshift-cluster-node-tuning-operator/tuned-zhmcb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal","openshift-multus/multus-additional-cni-plugins-jwjwb","openshift-multus/multus-nlwjc","openshift-multus/network-metrics-daemon-ckbdx","openshift-ovn-kubernetes/ovnkube-node-rvkgl","kube-system/konnectivity-agent-thfmv","kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal","openshift-dns/node-resolver-mcpdj","openshift-image-registry/node-ca-ql7lk"]
Jul 21 04:09:21.208611 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.208584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.210762 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.210734    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.212055 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.211809    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.212055 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.211873    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 04:09:21.212055 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.211955    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 04:09:21.212055 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.211967    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nnsbl\""
Jul 21 04:09:21.212055 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.212054    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 04:09:21.212375 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.212165    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.213083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.213066    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.213180 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.213154    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:21.214681 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.214658    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.214766 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.214715    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.214858 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.214768    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wb4gj\""
Jul 21 04:09:21.215549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.215528    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.217306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.217286    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 04:09:21.218121 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.218099    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.218217 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.218128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.218355 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.218333    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.219176 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.218799    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w5dpb\""
Jul 21 04:09:21.219176 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.219005    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 04:09:21.220729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.220459    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.220729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.220646    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.221208 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.221186    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7gfs7\""
Jul 21 04:09:21.221567 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.221414    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.223003 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.222978    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 04:09:21.223119 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.223100    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2j8hp\""
Jul 21 04:09:21.223463 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.223443    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.223655 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.223465    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.223754 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.223636    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:21.223869 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.223794    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.225728 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.225670    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:21.225828 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.225746    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:21.228242 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.228222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229258    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjr8x\" (UniqueName: \"kubernetes.io/projected/5d6cec48-d9db-4e69-bf64-f765409ebc21-kube-api-access-rjr8x\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229310    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-registration-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysctl-d\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.229468 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysctl-conf\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7btgt\" (UniqueName: \"kubernetes.io/projected/000e65b4-1400-44db-a04b-99509bd03df3-kube-api-access-7btgt\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-sys\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlh2w\" (UniqueName: \"kubernetes.io/projected/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-kube-api-access-xlh2w\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/000e65b4-1400-44db-a04b-99509bd03df3-host\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/000e65b4-1400-44db-a04b-99509bd03df3-serviceca\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-os-release\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-sys-fs\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-tuned\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-cni-binary-copy\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.229918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6cec48-d9db-4e69-bf64-f765409ebc21-tmp-dir\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-socket-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.229982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysconfig\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-device-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-modprobe-d\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-var-lib-kubelet\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-host\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-system-cni-dir\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-cnibin\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230216    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktzd\" (UniqueName: \"kubernetes.io/projected/2fdb106c-497a-46de-8104-1aa9efa70f55-kube-api-access-rktzd\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5d6cec48-d9db-4e69-bf64-f765409ebc21-hosts-file\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-tmp\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-kubelet-config\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-kubernetes\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-systemd\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-run\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.230530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-lib-modules\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.231214 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.231214 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230796    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-dbus\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.231214 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.230839    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4c8d\" (UniqueName: \"kubernetes.io/projected/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-kube-api-access-w4c8d\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.231566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.231544    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 04:09:21.231868 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.231779    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.232007 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.231987    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.232393 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.232374    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.236565 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.235520    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r59jz\""
Jul 21 04:09:21.238332 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238308    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 04:09:21.238448 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238336    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 04:09:21.238509 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vk4md\""
Jul 21 04:09:21.238662 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238631    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 04:09:21.238821 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238764    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 04:09:21.238821 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238807    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.238972 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238828    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 04:09:21.238972 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.238842    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 04:09:21.241395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.241361    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 04:09:21.241505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.241461    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lmg9s\""
Jul 21 04:09:21.241577 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.241558    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 04:09:21.241881 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.241864    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.244347 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.244281    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 04:09:21.244688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.244518    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4fpgg\""
Jul 21 04:09:21.248482 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.248459    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmz66"
Jul 21 04:09:21.256250 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.256228    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmz66"
Jul 21 04:09:21.319794 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.319758    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 04:09:21.323911 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.323885    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 04:09:21.331584 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331554    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-log-socket\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.331744 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-cni-bin\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.331744 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef114389-b1eb-4010-8898-dec6f47000c5-agent-certs\") pod \"konnectivity-agent-thfmv\" (UID: \"ef114389-b1eb-4010-8898-dec6f47000c5\") " pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.331744 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-sys\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/000e65b4-1400-44db-a04b-99509bd03df3-host\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-sys\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331779    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/000e65b4-1400-44db-a04b-99509bd03df3-host\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-system-cni-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-os-release\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-cni-multus\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-os-release\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.331940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-sys-fs\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.331990    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-multus-certs\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-slash\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6cec48-d9db-4e69-bf64-f765409ebc21-tmp-dir\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-os-release\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a53033d-e3cf-4025-9b78-2c0c4769105e-host-slash\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-etc-kubernetes\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-modprobe-d\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-sys-fs\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-var-lib-kubelet\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-host\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kx96\" (UniqueName: \"kubernetes.io/projected/0a53033d-e3cf-4025-9b78-2c0c4769105e-kube-api-access-5kx96\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-socket-dir-parent\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332238    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:21.332306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-cnibin\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktzd\" (UniqueName: \"kubernetes.io/projected/2fdb106c-497a-46de-8104-1aa9efa70f55-kube-api-access-rktzd\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332337    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-tmp\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332354    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08415d15-e118-4247-b7a7-fba68b82fba8-cni-binary-copy\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-cni-netd\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef114389-b1eb-4010-8898-dec6f47000c5-konnectivity-ca\") pod \"konnectivity-agent-thfmv\" (UID: \"ef114389-b1eb-4010-8898-dec6f47000c5\") " pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-kubernetes\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6cec48-d9db-4e69-bf64-f765409ebc21-tmp-dir\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-systemd\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-run\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332539    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-etc-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332556    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-ovnkube-script-lib\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4c8d\" (UniqueName: \"kubernetes.io/projected/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-kube-api-access-w4c8d\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-systemd-units\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-ovn\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-modprobe-d\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l572k\" (UniqueName: \"kubernetes.io/projected/04e203a2-4c23-4567-b9db-17ac107d24d3-kube-api-access-l572k\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.333106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-registration-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332690    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-var-lib-kubelet\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7btgt\" (UniqueName: \"kubernetes.io/projected/000e65b4-1400-44db-a04b-99509bd03df3-kube-api-access-7btgt\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-host\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-k8s-cni-cncf-io\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-cnibin\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332779    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-systemd\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlh2w\" (UniqueName: \"kubernetes.io/projected/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-kube-api-access-xlh2w\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332859    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/000e65b4-1400-44db-a04b-99509bd03df3-serviceca\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.332919    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.333021    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:21.832971296 +0000 UTC m=+2.910185785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333179    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-registration-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-run\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.333937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.332690    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04e203a2-4c23-4567-b9db-17ac107d24d3-ovn-node-metrics-cert\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-tuned\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333722    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-netns\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-env-overrides\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-cni-binary-copy\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.333924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-socket-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-socket-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334114    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-kubernetes\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334421    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-cni-binary-copy\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysconfig\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-systemd\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-ovnkube-config\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-device-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.334698 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-hostroot\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-node-log\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-system-cni-dir\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/000e65b4-1400-44db-a04b-99509bd03df3-serviceca\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fdb106c-497a-46de-8104-1aa9efa70f55-system-cni-dir\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-device-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334765    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysconfig\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5d6cec48-d9db-4e69-bf64-f765409ebc21-hosts-file\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5d6cec48-d9db-4e69-bf64-f765409ebc21-hosts-file\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-cnibin\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334936    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-conf-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr4qd\" (UniqueName: \"kubernetes.io/projected/08415d15-e118-4247-b7a7-fba68b82fba8-kube-api-access-jr4qd\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.334998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-kubelet-config\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-lib-modules\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-kubelet-config\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.335472 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-lib-modules\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335537    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-cni-bin\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-kubelet\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335577    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08415d15-e118-4247-b7a7-fba68b82fba8-multus-daemon-config\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335649    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-dbus\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a53033d-e3cf-4025-9b78-2c0c4769105e-iptables-alerter-script\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-cni-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cb98\" (UniqueName: \"kubernetes.io/projected/8dd1956a-3358-4238-afb8-7dae2afa9f72-kube-api-access-7cb98\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-run-netns\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-var-lib-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335796    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-dbus\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjr8x\" (UniqueName: \"kubernetes.io/projected/5d6cec48-d9db-4e69-bf64-f765409ebc21-kube-api-access-rjr8x\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysctl-d\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.336236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysctl-conf\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.337109 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.335918    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-kubelet\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.337109 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.336167    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysctl-d\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.337109 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.336229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.337109 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.336311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fdb106c-497a-46de-8104-1aa9efa70f55-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.337109 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.336344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-sysctl-conf\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.338367 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.338326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-etc-tuned\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.339080 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.339047    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-tmp\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.347772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.347687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlh2w\" (UniqueName: \"kubernetes.io/projected/1b6f3b32-a774-4f3e-90d3-1d7836842a1f-kube-api-access-xlh2w\") pod \"tuned-zhmcb\" (UID: \"1b6f3b32-a774-4f3e-90d3-1d7836842a1f\") " pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.347772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.347727    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7btgt\" (UniqueName: \"kubernetes.io/projected/000e65b4-1400-44db-a04b-99509bd03df3-kube-api-access-7btgt\") pod \"node-ca-ql7lk\" (UID: \"000e65b4-1400-44db-a04b-99509bd03df3\") " pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.348815 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.348785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4c8d\" (UniqueName: \"kubernetes.io/projected/0dcec2ea-65cc-49e4-953c-87cfaa381dd4-kube-api-access-w4c8d\") pod \"aws-ebs-csi-driver-node-dwmg2\" (UID: \"0dcec2ea-65cc-49e4-953c-87cfaa381dd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.350351 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.350321    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktzd\" (UniqueName: \"kubernetes.io/projected/2fdb106c-497a-46de-8104-1aa9efa70f55-kube-api-access-rktzd\") pod \"multus-additional-cni-plugins-jwjwb\" (UID: \"2fdb106c-497a-46de-8104-1aa9efa70f55\") " pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.350464 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.350361    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjr8x\" (UniqueName: \"kubernetes.io/projected/5d6cec48-d9db-4e69-bf64-f765409ebc21-kube-api-access-rjr8x\") pod \"node-resolver-mcpdj\" (UID: \"5d6cec48-d9db-4e69-bf64-f765409ebc21\") " pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.356830 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.356743    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" event={"ID":"4eee650cb360f6091758c87e5c6ae938","Type":"ContainerStarted","Data":"6a33b4b4974335756c837409362ade0fa1d764f051c74fa79cec6b43b05bf311"}
Jul 21 04:09:21.359511 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.359478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal" event={"ID":"5967dca527be5168794214a27e6630c4","Type":"ContainerStarted","Data":"18a76c57bf089ae4b54dac4ecbd2b5285f87cae4b35975890b0b0d2b41f2971a"}
Jul 21 04:09:21.436762 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-systemd\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.436762 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-ovnkube-config\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-hostroot\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-node-log\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436823    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-systemd\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-cnibin\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-conf-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-hostroot\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr4qd\" (UniqueName: \"kubernetes.io/projected/08415d15-e118-4247-b7a7-fba68b82fba8-kube-api-access-jr4qd\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-node-log\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436969    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-conf-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436997    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-cnibin\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.436923    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-cni-bin\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-cni-bin\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-kubelet\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08415d15-e118-4247-b7a7-fba68b82fba8-multus-daemon-config\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-kubelet\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a53033d-e3cf-4025-9b78-2c0c4769105e-iptables-alerter-script\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437191    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-cni-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cb98\" (UniqueName: \"kubernetes.io/projected/8dd1956a-3358-4238-afb8-7dae2afa9f72-kube-api-access-7cb98\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-run-netns\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-var-lib-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437407    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-kubelet\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-log-socket\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-cni-bin\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437476    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef114389-b1eb-4010-8898-dec6f47000c5-agent-certs\") pod \"konnectivity-agent-thfmv\" (UID: \"ef114389-b1eb-4010-8898-dec6f47000c5\") " pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.437575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-system-cni-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-os-release\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-cni-multus\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-ovnkube-config\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-multus-certs\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-slash\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437711    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-os-release\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437732    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08415d15-e118-4247-b7a7-fba68b82fba8-multus-daemon-config\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437771    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-run-netns\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437732    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a53033d-e3cf-4025-9b78-2c0c4769105e-iptables-alerter-script\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437793    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-cni-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-cni-bin\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a53033d-e3cf-4025-9b78-2c0c4769105e-host-slash\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-var-lib-cni-multus\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-etc-kubernetes\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437930    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-etc-kubernetes\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437947    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-var-lib-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.438408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437982    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-slash\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a53033d-e3cf-4025-9b78-2c0c4769105e-host-slash\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437870    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-kubelet\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.437737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-log-socket\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-system-cni-dir\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-multus-certs\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kx96\" (UniqueName: \"kubernetes.io/projected/0a53033d-e3cf-4025-9b78-2c0c4769105e-kube-api-access-5kx96\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-socket-dir-parent\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08415d15-e118-4247-b7a7-fba68b82fba8-cni-binary-copy\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438360    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-multus-socket-dir-parent\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-cni-netd\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.438398    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.438460    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:21.938440999 +0000 UTC m=+3.015655484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef114389-b1eb-4010-8898-dec6f47000c5-konnectivity-ca\") pod \"konnectivity-agent-thfmv\" (UID: \"ef114389-b1eb-4010-8898-dec6f47000c5\") " pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-etc-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.439154 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438539    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-ovnkube-script-lib\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-systemd-units\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-ovn\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438607    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-etc-openvswitch\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l572k\" (UniqueName: \"kubernetes.io/projected/04e203a2-4c23-4567-b9db-17ac107d24d3-kube-api-access-l572k\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-k8s-cni-cncf-io\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04e203a2-4c23-4567-b9db-17ac107d24d3-ovn-node-metrics-cert\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-netns\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-env-overrides\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-cni-netd\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08415d15-e118-4247-b7a7-fba68b82fba8-cni-binary-copy\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438926    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-k8s-cni-cncf-io\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08415d15-e118-4247-b7a7-fba68b82fba8-host-run-netns\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.438981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-systemd-units\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.439030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef114389-b1eb-4010-8898-dec6f47000c5-konnectivity-ca\") pod \"konnectivity-agent-thfmv\" (UID: \"ef114389-b1eb-4010-8898-dec6f47000c5\") " pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.439098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-run-ovn\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.440083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.439166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e203a2-4c23-4567-b9db-17ac107d24d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.441087 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.439382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-env-overrides\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.441087 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.440196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04e203a2-4c23-4567-b9db-17ac107d24d3-ovnkube-script-lib\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.441087 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.440663    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef114389-b1eb-4010-8898-dec6f47000c5-agent-certs\") pod \"konnectivity-agent-thfmv\" (UID: \"ef114389-b1eb-4010-8898-dec6f47000c5\") " pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.441393 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.441376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04e203a2-4c23-4567-b9db-17ac107d24d3-ovn-node-metrics-cert\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.445280 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.445254    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:21.445280 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.445282    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:21.445480 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.445296    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:21.445480 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.445370    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:09:21.945351318 +0000 UTC m=+3.022565793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:21.445997 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.445970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr4qd\" (UniqueName: \"kubernetes.io/projected/08415d15-e118-4247-b7a7-fba68b82fba8-kube-api-access-jr4qd\") pod \"multus-nlwjc\" (UID: \"08415d15-e118-4247-b7a7-fba68b82fba8\") " pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.447860 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.447833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kx96\" (UniqueName: \"kubernetes.io/projected/0a53033d-e3cf-4025-9b78-2c0c4769105e-kube-api-access-5kx96\") pod \"iptables-alerter-q5cn7\" (UID: \"0a53033d-e3cf-4025-9b78-2c0c4769105e\") " pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.448001 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.447980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cb98\" (UniqueName: \"kubernetes.io/projected/8dd1956a-3358-4238-afb8-7dae2afa9f72-kube-api-access-7cb98\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.448760 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.448705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l572k\" (UniqueName: \"kubernetes.io/projected/04e203a2-4c23-4567-b9db-17ac107d24d3-kube-api-access-l572k\") pod \"ovnkube-node-rvkgl\" (UID: \"04e203a2-4c23-4567-b9db-17ac107d24d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.522948 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.522902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jwjwb"
Jul 21 04:09:21.530838 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.530802    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mcpdj"
Jul 21 04:09:21.539944 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.539911    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2"
Jul 21 04:09:21.551842 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.551807    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhmcb"
Jul 21 04:09:21.568149 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.568114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ql7lk"
Jul 21 04:09:21.577469 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.577431    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q5cn7"
Jul 21 04:09:21.585940 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.585910    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:21.593094 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.593067    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:21.600223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.600195    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlwjc"
Jul 21 04:09:21.842206 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.842116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:21.842389 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.842308    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:21.842453 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.842408    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:22.842381097 +0000 UTC m=+3.919595582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:21.943197 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:21.943151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:21.943421 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.943279    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:21.943421 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:21.943359    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:22.943336122 +0000 UTC m=+4.020550613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:22.044588 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:22.044184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:22.044588 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.044362    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:22.044588 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.044384    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:22.044588 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.044396    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:22.044588 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.044461    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:09:23.044440865 +0000 UTC m=+4.121655348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:22.259694 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:22.259646    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 04:04:21 +0000 UTC" deadline="2027-12-21 20:38:51.345821219 +0000 UTC"
Jul 21 04:09:22.259694 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:22.259691    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12448h29m29.086135179s"
Jul 21 04:09:22.474027 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.473993    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcec2ea_65cc_49e4_953c_87cfaa381dd4.slice/crio-d7061600568f79f1bec1a76e7999a4d92de31248d93f6606b74ded41456ac976 WatchSource:0}: Error finding container d7061600568f79f1bec1a76e7999a4d92de31248d93f6606b74ded41456ac976: Status 404 returned error can't find the container with id d7061600568f79f1bec1a76e7999a4d92de31248d93f6606b74ded41456ac976
Jul 21 04:09:22.483040 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.483009    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6cec48_d9db_4e69_bf64_f765409ebc21.slice/crio-b497c3733f0a2c4d3548afdd6ac22342c001209aca262b58b521529241a30557 WatchSource:0}: Error finding container b497c3733f0a2c4d3548afdd6ac22342c001209aca262b58b521529241a30557: Status 404 returned error can't find the container with id b497c3733f0a2c4d3548afdd6ac22342c001209aca262b58b521529241a30557
Jul 21 04:09:22.486299 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.486271    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6f3b32_a774_4f3e_90d3_1d7836842a1f.slice/crio-71042f49ac973557f791e276194fb49212700a6d72dc0f4f5152ed83845f052b WatchSource:0}: Error finding container 71042f49ac973557f791e276194fb49212700a6d72dc0f4f5152ed83845f052b: Status 404 returned error can't find the container with id 71042f49ac973557f791e276194fb49212700a6d72dc0f4f5152ed83845f052b
Jul 21 04:09:22.487365 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.487336    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08415d15_e118_4247_b7a7_fba68b82fba8.slice/crio-1816e61807ca3cb2dd46ff4e854e6c484fa1d54252dff2f79fce308874fc07a0 WatchSource:0}: Error finding container 1816e61807ca3cb2dd46ff4e854e6c484fa1d54252dff2f79fce308874fc07a0: Status 404 returned error can't find the container with id 1816e61807ca3cb2dd46ff4e854e6c484fa1d54252dff2f79fce308874fc07a0
Jul 21 04:09:22.488247 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.488207    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a53033d_e3cf_4025_9b78_2c0c4769105e.slice/crio-d23b1dd0bf8f248b767e8ffc81c318483a6205356dfb3aaaa68fa983a02e3dd3 WatchSource:0}: Error finding container d23b1dd0bf8f248b767e8ffc81c318483a6205356dfb3aaaa68fa983a02e3dd3: Status 404 returned error can't find the container with id d23b1dd0bf8f248b767e8ffc81c318483a6205356dfb3aaaa68fa983a02e3dd3
Jul 21 04:09:22.489147 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.489123    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000e65b4_1400_44db_a04b_99509bd03df3.slice/crio-d51ccc72a60058cb1e2a5bd3041976fe6300d1b12b5b5d31c6038414be785879 WatchSource:0}: Error finding container d51ccc72a60058cb1e2a5bd3041976fe6300d1b12b5b5d31c6038414be785879: Status 404 returned error can't find the container with id d51ccc72a60058cb1e2a5bd3041976fe6300d1b12b5b5d31c6038414be785879
Jul 21 04:09:22.493755 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:22.493620    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdb106c_497a_46de_8104_1aa9efa70f55.slice/crio-6d432c5ed5d3477359b67a9e1fc4629c1b28bf20170ccee603fdb4926ca4a924 WatchSource:0}: Error finding container 6d432c5ed5d3477359b67a9e1fc4629c1b28bf20170ccee603fdb4926ca4a924: Status 404 returned error can't find the container with id 6d432c5ed5d3477359b67a9e1fc4629c1b28bf20170ccee603fdb4926ca4a924
Jul 21 04:09:22.852187 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:22.851936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:22.852355 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.852103    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:22.852355 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.852270    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:24.852246653 +0000 UTC m=+5.929461122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:22.953604 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:22.953560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:22.953802 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.953762    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:22.953890 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:22.953859    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:24.953825166 +0000 UTC m=+6.031039638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:23.055258 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.054514    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:23.055258 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.054775    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:23.055258 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.054799    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:23.055258 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.054813    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:23.055258 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.054878    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:09:25.054857336 +0000 UTC m=+6.132071810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:23.260877 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.260700    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 04:04:21 +0000 UTC" deadline="2027-12-26 11:54:20.243473977 +0000 UTC"
Jul 21 04:09:23.260877 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.260784    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12559h44m56.982694831s"
Jul 21 04:09:23.354165 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.354129    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:23.354349 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.354279    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:23.354428 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.354376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:23.354492 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.354463    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:23.354548 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.354536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:23.355052 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:23.354623    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:23.367661 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.367620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal" event={"ID":"5967dca527be5168794214a27e6630c4","Type":"ContainerStarted","Data":"c78e8f0b37dcdbfe477cccde3bb19e167df5d0a0678abfe66b0bb6623a850e60"}
Jul 21 04:09:23.382501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.382420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerStarted","Data":"6d432c5ed5d3477359b67a9e1fc4629c1b28bf20170ccee603fdb4926ca4a924"}
Jul 21 04:09:23.385036 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.383694    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-95.ec2.internal" podStartSLOduration=2.383671504 podStartE2EDuration="2.383671504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:23.383121274 +0000 UTC m=+4.460335768" watchObservedRunningTime="2026-07-21 04:09:23.383671504 +0000 UTC m=+4.460885998"
Jul 21 04:09:23.398465 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.398419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ql7lk" event={"ID":"000e65b4-1400-44db-a04b-99509bd03df3","Type":"ContainerStarted","Data":"d51ccc72a60058cb1e2a5bd3041976fe6300d1b12b5b5d31c6038414be785879"}
Jul 21 04:09:23.410400 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.410340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhmcb" event={"ID":"1b6f3b32-a774-4f3e-90d3-1d7836842a1f","Type":"ContainerStarted","Data":"71042f49ac973557f791e276194fb49212700a6d72dc0f4f5152ed83845f052b"}
Jul 21 04:09:23.414010 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.413975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mcpdj" event={"ID":"5d6cec48-d9db-4e69-bf64-f765409ebc21","Type":"ContainerStarted","Data":"b497c3733f0a2c4d3548afdd6ac22342c001209aca262b58b521529241a30557"}
Jul 21 04:09:23.416303 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.416266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2" event={"ID":"0dcec2ea-65cc-49e4-953c-87cfaa381dd4","Type":"ContainerStarted","Data":"d7061600568f79f1bec1a76e7999a4d92de31248d93f6606b74ded41456ac976"}
Jul 21 04:09:23.427293 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.427245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"bffd4e638e6e1c908e7201949d7aae547a212beffaeeed0401153df75efed269"}
Jul 21 04:09:23.436184 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.436102    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thfmv" event={"ID":"ef114389-b1eb-4010-8898-dec6f47000c5","Type":"ContainerStarted","Data":"23c7fba4f1c9b87cf675f5440c6fd3b686a2462899929f2de8bb45a3be65e90e"}
Jul 21 04:09:23.467297 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.467138    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q5cn7" event={"ID":"0a53033d-e3cf-4025-9b78-2c0c4769105e","Type":"ContainerStarted","Data":"d23b1dd0bf8f248b767e8ffc81c318483a6205356dfb3aaaa68fa983a02e3dd3"}
Jul 21 04:09:23.470954 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.470907    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlwjc" event={"ID":"08415d15-e118-4247-b7a7-fba68b82fba8","Type":"ContainerStarted","Data":"1816e61807ca3cb2dd46ff4e854e6c484fa1d54252dff2f79fce308874fc07a0"}
Jul 21 04:09:23.492677 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.492086    2567 generic.go:356] "Generic (PLEG): container finished" podID="4eee650cb360f6091758c87e5c6ae938" containerID="dcb80417d5e01e6d4e16d38c573bca8bf28af394d1aa6bb0b4ddb864a847dc35" exitCode=0
Jul 21 04:09:23.492677 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:23.492138    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" event={"ID":"4eee650cb360f6091758c87e5c6ae938","Type":"ContainerDied","Data":"dcb80417d5e01e6d4e16d38c573bca8bf28af394d1aa6bb0b4ddb864a847dc35"}
Jul 21 04:09:24.532745 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:24.532693    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" event={"ID":"4eee650cb360f6091758c87e5c6ae938","Type":"ContainerStarted","Data":"fb4785d83a056a4ccb33de8573d82032f21863f866d04850498c6c17b99692f0"}
Jul 21 04:09:24.869112 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:24.869065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:24.869373 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:24.869237    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:24.869373 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:24.869306    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:28.869286666 +0000 UTC m=+9.946501194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:24.970164 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:24.970117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:24.970361 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:24.970348    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:24.970426 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:24.970418    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:28.970397271 +0000 UTC m=+10.047611744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:25.071104 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:25.071061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:25.071297 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.071273    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:25.071378 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.071307    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:25.071378 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.071323    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:25.071485 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.071393    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:09:29.07137102 +0000 UTC m=+10.148585505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:25.369522 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:25.368578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:25.369522 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.368711    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:25.369522 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:25.369164    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:25.369522 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.369281    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:25.369522 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:25.369342    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:25.369522 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:25.369411    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:27.357643 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:27.356807    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:27.357643 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:27.356946    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:27.357643 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:27.357361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:27.357643 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:27.357474    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:27.357643 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:27.357521    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:27.357643 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:27.357592    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:28.907759 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:28.907703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:28.908338 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:28.907880    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:28.908338 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:28.907968    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:36.907942611 +0000 UTC m=+17.985157106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:29.008726 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:29.008676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:29.008913 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.008861    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:29.009026 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.008942    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:37.008916787 +0000 UTC m=+18.086131276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:29.109172 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:29.109090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:29.109343 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.109292    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:29.109343 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.109321    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:29.109343 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.109338    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:29.109476 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.109409    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:09:37.109386166 +0000 UTC m=+18.186600636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:29.353509 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:29.352943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:29.353509 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.353077    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:29.353509 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:29.353147    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:29.353509 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.353219    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:29.353909 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:29.353592    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:29.353909 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:29.353687    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:31.356379 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:31.355561    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:31.356379 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:31.355697    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:31.356379 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:31.356106    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:31.356379 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:31.356196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:31.356379 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:31.356256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:31.356379 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:31.356339    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:33.352418 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:33.352387    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:33.352817 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:33.352387    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:33.352817 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:33.352494    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:33.352817 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:33.352597    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:33.352817 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:33.352396    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:33.352817 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:33.352718    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:35.352434 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:35.352398    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:35.352902 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:35.352399    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:35.352902 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:35.352532    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:35.352902 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:35.352632    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:35.352902 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:35.352406    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:35.352902 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:35.352771    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:36.976147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:36.976098    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:36.976683 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:36.976280    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:36.976683 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:36.976371    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:52.97634831 +0000 UTC m=+34.053562797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:37.076569 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:37.076533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:37.076769 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.076731    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:37.076821 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.076813    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:53.076790628 +0000 UTC m=+34.154005112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:37.177814 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:37.177777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:37.177975 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.177961    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:37.178030 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.177986    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:37.178030 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.177999    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:37.178099 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.178051    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:09:53.17803646 +0000 UTC m=+34.255250931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:37.352573 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:37.352536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:37.352763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:37.352539    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:37.352763 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.352679    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:37.352763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:37.352698    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:37.352930 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.352797    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:37.352930 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:37.352885    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:39.352701 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:39.352666    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:39.353201 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:39.352791    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:39.353201 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:39.352879    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:39.353201 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:39.353002    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:39.353201 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:39.353035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:39.353201 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:39.353177    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:41.352156 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:41.352117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:41.352702 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:41.352170    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:41.352702 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:41.352128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:41.352702 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:41.352273    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:41.352702 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:41.352388    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:41.352702 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:41.352518    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:42.573986 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.573636    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mcpdj" event={"ID":"5d6cec48-d9db-4e69-bf64-f765409ebc21","Type":"ContainerStarted","Data":"b4e56ef26d46fae0c493810a7341011e1d57acccc6ab80a470d4525e230f346a"}
Jul 21 04:09:42.575359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.575327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2" event={"ID":"0dcec2ea-65cc-49e4-953c-87cfaa381dd4","Type":"ContainerStarted","Data":"c9a83a0a65d37a42f1375421cc833bb603d7e59890c80efdea00c98722cfc0f4"}
Jul 21 04:09:42.578884 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.578848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"44911f0b1460ede071aec76b16b219013aa8bcee9c6586be0135d574f5620f76"}
Jul 21 04:09:42.579053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.578937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"54894a74144f663fd4d1c863a32a28b149fd8f29a248708684a2235280f040d2"}
Jul 21 04:09:42.579053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.578984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"a6a7237f6873fa4dd9625b51f1a2e36ae8e8769ad38305b9ba737a45e764a446"}
Jul 21 04:09:42.579053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.579013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"243feb3dd400cbd4e7e99190d75b925b968942a9b0bc599ef4dedbe42c98908b"}
Jul 21 04:09:42.579053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.579040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"8d2657dc4ecb65414d78a4662880dec53543b355591c65f6ae9308257fc12437"}
Jul 21 04:09:42.579224 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.579067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"5d322bbce0a06765158836676cb6b2a5cfaca9eb2c0a21c72512d7e6be4935ae"}
Jul 21 04:09:42.580615 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.580573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thfmv" event={"ID":"ef114389-b1eb-4010-8898-dec6f47000c5","Type":"ContainerStarted","Data":"79dbb8bdf4680d08a5b9907f5faaa8728bfe7969a1795dd4b499a474877aca1c"}
Jul 21 04:09:42.582191 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.582166    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlwjc" event={"ID":"08415d15-e118-4247-b7a7-fba68b82fba8","Type":"ContainerStarted","Data":"3f8945975afb1a91f0190b0965ee0a20788738294b991923e5f681e7d92bd70f"}
Jul 21 04:09:42.583817 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.583793    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fdb106c-497a-46de-8104-1aa9efa70f55" containerID="3a510f13a2ea1ff4906002c55ecf2cacd5caaa3f6e60ba554831d8e0a28797d4" exitCode=0
Jul 21 04:09:42.583934 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.583873    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerDied","Data":"3a510f13a2ea1ff4906002c55ecf2cacd5caaa3f6e60ba554831d8e0a28797d4"}
Jul 21 04:09:42.585868 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.585835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ql7lk" event={"ID":"000e65b4-1400-44db-a04b-99509bd03df3","Type":"ContainerStarted","Data":"a52f39387e4be4cb99df5754f84f7cd7a4d4b8754261a6d556a075a633fae31d"}
Jul 21 04:09:42.587417 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.587326    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhmcb" event={"ID":"1b6f3b32-a774-4f3e-90d3-1d7836842a1f","Type":"ContainerStarted","Data":"87648938a6fb43f3a21430b9b93eea74aa4ae6943da932e084d34d1cff2ba76d"}
Jul 21 04:09:42.589746 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.589690    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-95.ec2.internal" podStartSLOduration=21.589677406 podStartE2EDuration="21.589677406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:24.552862372 +0000 UTC m=+5.630076882" watchObservedRunningTime="2026-07-21 04:09:42.589677406 +0000 UTC m=+23.666891895"
Jul 21 04:09:42.590366 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.590320    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mcpdj" podStartSLOduration=7.608617799 podStartE2EDuration="22.590308329s" totalImagesPullingTime="14.98169053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:42.589388316 +0000 UTC m=+23.666602801" watchObservedRunningTime="2026-07-21 04:09:42.590308329 +0000 UTC m=+23.667522818"
Jul 21 04:09:42.603316 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.603264    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ql7lk" podStartSLOduration=3.415274271 podStartE2EDuration="22.6032474s" totalImagesPullingTime="19.187973129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:42.603232762 +0000 UTC m=+23.680447250" watchObservedRunningTime="2026-07-21 04:09:42.6032474 +0000 UTC m=+23.680461888"
Jul 21 04:09:42.617573 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.617521    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-thfmv" podStartSLOduration=7.64370111 podStartE2EDuration="22.617506912s" totalImagesPullingTime="14.973805802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:42.617220437 +0000 UTC m=+23.694434928" watchObservedRunningTime="2026-07-21 04:09:42.617506912 +0000 UTC m=+23.694721401"
Jul 21 04:09:42.655014 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.654964    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zhmcb" podStartSLOduration=3.463848595 podStartE2EDuration="22.654948144s" totalImagesPullingTime="19.191099549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:42.654726891 +0000 UTC m=+23.731941373" watchObservedRunningTime="2026-07-21 04:09:42.654948144 +0000 UTC m=+23.732162633"
Jul 21 04:09:42.674814 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:42.674764    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nlwjc" podStartSLOduration=3.4226492139999998 podStartE2EDuration="22.674747906s" totalImagesPullingTime="19.252098692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:42.674479973 +0000 UTC m=+23.751694462" watchObservedRunningTime="2026-07-21 04:09:42.674747906 +0000 UTC m=+23.751962395"
Jul 21 04:09:43.206916 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.206884    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:43.207486 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.207459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:43.281067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.281029    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 04:09:43.299281 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.299121    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T04:09:43.281050875Z","UUID":"8b4348f4-b797-4d50-b193-dafc771f3581","Handler":null,"Name":"","Endpoint":""}
Jul 21 04:09:43.301041 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.301013    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 04:09:43.301160 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.301081    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 04:09:43.351893 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.351863    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:43.352087 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.351862    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:43.352087 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:43.351989    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:43.352200 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:43.352091    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:43.352200 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.351873    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:43.352296 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:43.352196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:43.592172 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.592081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2" event={"ID":"0dcec2ea-65cc-49e4-953c-87cfaa381dd4","Type":"ContainerStarted","Data":"e876785a933eeeac5762238228543dca96788126d79dbed27a4223750305ffb1"}
Jul 21 04:09:43.593810 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.593778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q5cn7" event={"ID":"0a53033d-e3cf-4025-9b78-2c0c4769105e","Type":"ContainerStarted","Data":"482c148672a926d30a398d4f85b66db8fce7f26e841891c34d7d7da0183eac84"}
Jul 21 04:09:43.609629 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:43.609565    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q5cn7" podStartSLOduration=4.420348483 podStartE2EDuration="23.609543248s" totalImagesPullingTime="19.189194765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:43.60891308 +0000 UTC m=+24.686127591" watchObservedRunningTime="2026-07-21 04:09:43.609543248 +0000 UTC m=+24.686757740"
Jul 21 04:09:44.598744 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:44.598689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2" event={"ID":"0dcec2ea-65cc-49e4-953c-87cfaa381dd4","Type":"ContainerStarted","Data":"04267793ae22fef257e1b2fefb11443ad3088e7796155b0e948ace424edb80c1"}
Jul 21 04:09:44.602431 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:44.602409    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 04:09:44.602590 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:44.602431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"15634cb03c5072c3542792ca3946a380cc65d88bb4eec9b16b79d6b9d44355f4"}
Jul 21 04:09:44.619721 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:44.619642    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwmg2" podStartSLOduration=3.231709244 podStartE2EDuration="24.619622267s" totalImagesPullingTime="21.387913023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:44.618980572 +0000 UTC m=+25.696195064" watchObservedRunningTime="2026-07-21 04:09:44.619622267 +0000 UTC m=+25.696836757"
Jul 21 04:09:45.352073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:45.352037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:45.352073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:45.352068    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:45.352366 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:45.352037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:45.352366 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:45.352163    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:45.352366 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:45.352283    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:45.352583 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:45.352391    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:46.010881 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:46.010837    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:46.011414 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:46.011063    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 04:09:46.011562 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:46.011539    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-thfmv"
Jul 21 04:09:47.351953 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.351928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:47.352516 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.351928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:47.352516 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.352033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:47.352516 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:47.352058    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:47.352516 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:47.352092    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:47.352516 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:47.352151    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:47.610853 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.610820    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fdb106c-497a-46de-8104-1aa9efa70f55" containerID="1a90f76dcd04ec1318f4d67b92a4695aaff7ea829825ecee581e27b1726f5ea9" exitCode=0
Jul 21 04:09:47.611019 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.610903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerDied","Data":"1a90f76dcd04ec1318f4d67b92a4695aaff7ea829825ecee581e27b1726f5ea9"}
Jul 21 04:09:47.614875 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.614840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" event={"ID":"04e203a2-4c23-4567-b9db-17ac107d24d3","Type":"ContainerStarted","Data":"9882557887a84906b98f4de6e59d3207015ae5e8f259c26c0cc82938a1615607"}
Jul 21 04:09:47.615153 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.615134    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:47.615283 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.615199    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:47.630649 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.630620    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:47.664445 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:47.664395    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl" podStartSLOduration=8.411468841 podStartE2EDuration="27.66437746s" totalImagesPullingTime="19.252908619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:47.663986775 +0000 UTC m=+28.741201276" watchObservedRunningTime="2026-07-21 04:09:47.66437746 +0000 UTC m=+28.741591948"
Jul 21 04:09:48.618104 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:48.618057    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:48.634379 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:48.634348    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:09:49.353277 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.353241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:49.353422 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:49.353343    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:49.353422 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.353365    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:49.353422 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.353394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:49.353541 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:49.353483    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:49.353604 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:49.353582    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:49.435876 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.435837    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdtdh"]
Jul 21 04:09:49.438817 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.438785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdsg9"]
Jul 21 04:09:49.439333 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.439308    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ckbdx"]
Jul 21 04:09:49.622082 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.622043    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fdb106c-497a-46de-8104-1aa9efa70f55" containerID="77537f583a44ef62dc464ca1b12d09e013c6a65f27a3fa557a10e4817e7644f5" exitCode=0
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.622141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerDied","Data":"77537f583a44ef62dc464ca1b12d09e013c6a65f27a3fa557a10e4817e7644f5"}
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.622214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:49.622315    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.622357    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:49.622384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:49.622463    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:49.622561 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:49.622521    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:51.352229 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:51.352185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:51.352229 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:51.352231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:51.352805 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:51.352185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:51.352805 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:51.352298    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:51.352805 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:51.352367    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:51.352805 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:51.352446    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:51.630099 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:51.630067    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fdb106c-497a-46de-8104-1aa9efa70f55" containerID="4a5191fea85fbd28ea2797f02b04f48b80f0a038e5770c0ba6281d813294ec5d" exitCode=0
Jul 21 04:09:51.630322 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:51.630133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerDied","Data":"4a5191fea85fbd28ea2797f02b04f48b80f0a038e5770c0ba6281d813294ec5d"}
Jul 21 04:09:52.993649 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:52.993602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:52.994272 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:52.993790    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:52.994272 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:52.993871    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret podName:625bb5d4-3d41-4cef-9765-cdf270e7a9a9 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:24.993850417 +0000 UTC m=+66.071064896 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret") pod "global-pull-secret-syncer-fdtdh" (UID: "625bb5d4-3d41-4cef-9765-cdf270e7a9a9") : object "kube-system"/"original-pull-secret" not registered
Jul 21 04:09:53.095215 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:53.095173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:53.095398 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.095362    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:53.095452 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.095443    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs podName:8dd1956a-3358-4238-afb8-7dae2afa9f72 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:25.095422763 +0000 UTC m=+66.172637245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs") pod "network-metrics-daemon-ckbdx" (UID: "8dd1956a-3358-4238-afb8-7dae2afa9f72") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 04:09:53.196377 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:53.196327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:53.196560 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.196532    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 04:09:53.196560 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.196559    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 04:09:53.196652 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.196575    2567 projected.go:196] Error preparing data for projected volume kube-api-access-pclxp for pod openshift-network-diagnostics/network-check-target-bdsg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:53.196652 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.196645    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp podName:78d694b8-2472-41a3-bf77-2794a4c0ff7a nodeName:}" failed. No retries permitted until 2026-07-21 04:10:25.196621919 +0000 UTC m=+66.273836406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pclxp" (UniqueName: "kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp") pod "network-check-target-bdsg9" (UID: "78d694b8-2472-41a3-bf77-2794a4c0ff7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 04:09:53.352362 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:53.352330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:53.352552 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:53.352330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:53.352552 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.352469    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ckbdx" podUID="8dd1956a-3358-4238-afb8-7dae2afa9f72"
Jul 21 04:09:53.352552 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:53.352330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:53.352552 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.352535    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdsg9" podUID="78d694b8-2472-41a3-bf77-2794a4c0ff7a"
Jul 21 04:09:53.352755 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:53.352625    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fdtdh" podUID="625bb5d4-3d41-4cef-9765-cdf270e7a9a9"
Jul 21 04:09:54.243439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.243407    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-95.ec2.internal" event="NodeReady"
Jul 21 04:09:54.244077 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.243539    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 04:09:54.285720 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.285674    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d544b846f-7mzjb"]
Jul 21 04:09:54.290911 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.290882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.293890 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.293856    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 04:09:54.294065 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.293855    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 04:09:54.294371 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.294342    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jngx5\""
Jul 21 04:09:54.294894 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.294869    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 04:09:54.298790 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.298757    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5jsg4"]
Jul 21 04:09:54.302738 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.302693    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 04:09:54.302910 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.302771    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.305970 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.305944    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cfpnb"]
Jul 21 04:09:54.306083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.305995    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b7grb\""
Jul 21 04:09:54.306320 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.306305    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 04:09:54.306917 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.306896    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 04:09:54.310812 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.309883    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.312047 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.312023    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d544b846f-7mzjb"]
Jul 21 04:09:54.316083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.316059    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5jsg4"]
Jul 21 04:09:54.317218 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.317199    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zksv2\""
Jul 21 04:09:54.317376 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.317234    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 04:09:54.317443 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.317395    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 04:09:54.317506 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.317453    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 04:09:54.325451 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.325410    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cfpnb"]
Jul 21 04:09:54.404361 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-bound-sa-token\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404531 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-image-registry-private-configuration\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404531 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-ca-trust-extracted\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404531 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l27cb\" (UniqueName: \"kubernetes.io/projected/7af66331-9ca6-4122-88c8-1ffafc788501-kube-api-access-l27cb\") pod \"ingress-canary-cfpnb\" (UID: \"7af66331-9ca6-4122-88c8-1ffafc788501\") " pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.404531 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-installation-pull-secrets\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404531 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad67e36-9907-4537-8973-ed2f3b244c96-config-volume\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ad67e36-9907-4537-8973-ed2f3b244c96-tmp-dir\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af66331-9ca6-4122-88c8-1ffafc788501-cert\") pod \"ingress-canary-cfpnb\" (UID: \"7af66331-9ca6-4122-88c8-1ffafc788501\") " pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-trusted-ca\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-certificates\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjdw7\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-kube-api-access-zjdw7\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.404774 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.404775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnxj4\" (UniqueName: \"kubernetes.io/projected/3ad67e36-9907-4537-8973-ed2f3b244c96-kube-api-access-xnxj4\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.505886 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.505793    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af66331-9ca6-4122-88c8-1ffafc788501-cert\") pod \"ingress-canary-cfpnb\" (UID: \"7af66331-9ca6-4122-88c8-1ffafc788501\") " pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.505886 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.505847    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-trusted-ca\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.505886 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.505878    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.505905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-certificates\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.505934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjdw7\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-kube-api-access-zjdw7\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.505977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnxj4\" (UniqueName: \"kubernetes.io/projected/3ad67e36-9907-4537-8973-ed2f3b244c96-kube-api-access-xnxj4\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506043    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-bound-sa-token\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:54.506058    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-image-registry-private-configuration\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-ca-trust-extracted\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l27cb\" (UniqueName: \"kubernetes.io/projected/7af66331-9ca6-4122-88c8-1ffafc788501-kube-api-access-l27cb\") pod \"ingress-canary-cfpnb\" (UID: \"7af66331-9ca6-4122-88c8-1ffafc788501\") " pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-installation-pull-secrets\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad67e36-9907-4537-8973-ed2f3b244c96-config-volume\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ad67e36-9907-4537-8973-ed2f3b244c96-tmp-dir\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:54.506355    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:54.506368    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d544b846f-7mzjb: secret "image-registry-tls" not found
Jul 21 04:09:54.506439 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:54.506430    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls podName:9cbaaec4-51ec-4d31-a3e2-e90f96c990ea nodeName:}" failed. No retries permitted until 2026-07-21 04:09:55.006412669 +0000 UTC m=+36.083627143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls") pod "image-registry-6d544b846f-7mzjb" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea") : secret "image-registry-tls" not found
Jul 21 04:09:54.506851 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:54.506459    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls podName:3ad67e36-9907-4537-8973-ed2f3b244c96 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:55.006449174 +0000 UTC m=+36.083663648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls") pod "dns-default-5jsg4" (UID: "3ad67e36-9907-4537-8973-ed2f3b244c96") : secret "dns-default-metrics-tls" not found
Jul 21 04:09:54.506851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-certificates\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.506851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-ca-trust-extracted\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.507002 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.506957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-trusted-ca\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.507232 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.507201    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ad67e36-9907-4537-8973-ed2f3b244c96-tmp-dir\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.507487 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.507465    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad67e36-9907-4537-8973-ed2f3b244c96-config-volume\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.510980 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.510943    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-image-registry-private-configuration\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.510980 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.510965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-installation-pull-secrets\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.510980 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.510974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af66331-9ca6-4122-88c8-1ffafc788501-cert\") pod \"ingress-canary-cfpnb\" (UID: \"7af66331-9ca6-4122-88c8-1ffafc788501\") " pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.515325 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.515304    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l27cb\" (UniqueName: \"kubernetes.io/projected/7af66331-9ca6-4122-88c8-1ffafc788501-kube-api-access-l27cb\") pod \"ingress-canary-cfpnb\" (UID: \"7af66331-9ca6-4122-88c8-1ffafc788501\") " pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:54.516566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.516542    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-bound-sa-token\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.516737 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.516694    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnxj4\" (UniqueName: \"kubernetes.io/projected/3ad67e36-9907-4537-8973-ed2f3b244c96-kube-api-access-xnxj4\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:54.516737 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.516722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjdw7\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-kube-api-access-zjdw7\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:54.623377 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:54.623339    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cfpnb"
Jul 21 04:09:55.011496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.011450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:55.011731 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.011507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:55.011731 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:55.011625    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:09:55.011731 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:55.011696    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls podName:3ad67e36-9907-4537-8973-ed2f3b244c96 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:56.011676007 +0000 UTC m=+37.088890479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls") pod "dns-default-5jsg4" (UID: "3ad67e36-9907-4537-8973-ed2f3b244c96") : secret "dns-default-metrics-tls" not found
Jul 21 04:09:55.011731 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:55.011624    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:09:55.011931 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:55.011746    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d544b846f-7mzjb: secret "image-registry-tls" not found
Jul 21 04:09:55.011931 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:55.011807    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls podName:9cbaaec4-51ec-4d31-a3e2-e90f96c990ea nodeName:}" failed. No retries permitted until 2026-07-21 04:09:56.01178798 +0000 UTC m=+37.089002454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls") pod "image-registry-6d544b846f-7mzjb" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea") : secret "image-registry-tls" not found
Jul 21 04:09:55.352158 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.352117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:09:55.352638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.352118    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:09:55.352638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.352117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:09:55.355365 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.355341    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:09:55.355509 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.355347    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:09:55.356565 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.356544    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:09:55.356736 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.356609    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qwqtb\""
Jul 21 04:09:55.356736 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.356637    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v8hm\""
Jul 21 04:09:55.356736 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.356661    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:09:55.673499 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:55.673470    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cfpnb"]
Jul 21 04:09:55.683778 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:09:55.683752    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af66331_9ca6_4122_88c8_1ffafc788501.slice/crio-f39eb44057d21fbe999c9c1c2df67a69b1509be6da2efe7bf9b156d1f3882b87 WatchSource:0}: Error finding container f39eb44057d21fbe999c9c1c2df67a69b1509be6da2efe7bf9b156d1f3882b87: Status 404 returned error can't find the container with id f39eb44057d21fbe999c9c1c2df67a69b1509be6da2efe7bf9b156d1f3882b87
Jul 21 04:09:56.018881 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:56.018800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:56.019020 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:56.018902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:56.019020 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:56.018948    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:09:56.019020 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:56.018995    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:09:56.019020 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:56.019008    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d544b846f-7mzjb: secret "image-registry-tls" not found
Jul 21 04:09:56.019020 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:56.019016    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls podName:3ad67e36-9907-4537-8973-ed2f3b244c96 nodeName:}" failed. No retries permitted until 2026-07-21 04:09:58.01899837 +0000 UTC m=+39.096212841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls") pod "dns-default-5jsg4" (UID: "3ad67e36-9907-4537-8973-ed2f3b244c96") : secret "dns-default-metrics-tls" not found
Jul 21 04:09:56.019229 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:56.019048    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls podName:9cbaaec4-51ec-4d31-a3e2-e90f96c990ea nodeName:}" failed. No retries permitted until 2026-07-21 04:09:58.019036868 +0000 UTC m=+39.096251335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls") pod "image-registry-6d544b846f-7mzjb" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea") : secret "image-registry-tls" not found
Jul 21 04:09:56.646138 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:56.646100    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fdb106c-497a-46de-8104-1aa9efa70f55" containerID="e2044488a12e014694f4ac157a095d49b2bae78a7db230cd557223aacaa7c463" exitCode=0
Jul 21 04:09:56.646664 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:56.646184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerDied","Data":"e2044488a12e014694f4ac157a095d49b2bae78a7db230cd557223aacaa7c463"}
Jul 21 04:09:56.647645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:56.647386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cfpnb" event={"ID":"7af66331-9ca6-4122-88c8-1ffafc788501","Type":"ContainerStarted","Data":"f39eb44057d21fbe999c9c1c2df67a69b1509be6da2efe7bf9b156d1f3882b87"}
Jul 21 04:09:57.654777 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:57.654741    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fdb106c-497a-46de-8104-1aa9efa70f55" containerID="f81ceb895175de3347fbf94d582226cdafcec154f50b917bc3ae5dacb4aee6e4" exitCode=0
Jul 21 04:09:57.655166 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:57.654788    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerDied","Data":"f81ceb895175de3347fbf94d582226cdafcec154f50b917bc3ae5dacb4aee6e4"}
Jul 21 04:09:58.036820 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:58.036777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:09:58.036820 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:58.036825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:09:58.037045 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:58.036940    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:09:58.037045 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:58.036955    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:09:58.037045 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:58.036966    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d544b846f-7mzjb: secret "image-registry-tls" not found
Jul 21 04:09:58.037045 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:58.037026    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls podName:3ad67e36-9907-4537-8973-ed2f3b244c96 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:02.037009658 +0000 UTC m=+43.114224141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls") pod "dns-default-5jsg4" (UID: "3ad67e36-9907-4537-8973-ed2f3b244c96") : secret "dns-default-metrics-tls" not found
Jul 21 04:09:58.037045 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:09:58.037041    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls podName:9cbaaec4-51ec-4d31-a3e2-e90f96c990ea nodeName:}" failed. No retries permitted until 2026-07-21 04:10:02.037035723 +0000 UTC m=+43.114250203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls") pod "image-registry-6d544b846f-7mzjb" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea") : secret "image-registry-tls" not found
Jul 21 04:09:58.658412 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:58.658373    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cfpnb" event={"ID":"7af66331-9ca6-4122-88c8-1ffafc788501","Type":"ContainerStarted","Data":"0e33671af6856d66bc0a260aaea757134c465f5823da34dd0fa643ef9c84c5f5"}
Jul 21 04:09:58.661495 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:58.661463    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" event={"ID":"2fdb106c-497a-46de-8104-1aa9efa70f55","Type":"ContainerStarted","Data":"f5f199770f3aec4b77e008add38154be096eede48f5d043eaee1517c5d53fad9"}
Jul 21 04:09:58.678024 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:58.677971    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cfpnb" podStartSLOduration=2.5460485 podStartE2EDuration="4.677952436s" totalImagesPullingTime="2.131903936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:58.677506633 +0000 UTC m=+39.754721123" watchObservedRunningTime="2026-07-21 04:09:58.677952436 +0000 UTC m=+39.755166924"
Jul 21 04:09:58.703827 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:09:58.703778    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jwjwb" podStartSLOduration=8.748857236 podStartE2EDuration="38.703761115s" totalImagesPullingTime="29.954903879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:09:58.702817981 +0000 UTC m=+39.780032491" watchObservedRunningTime="2026-07-21 04:09:58.703761115 +0000 UTC m=+39.780975603"
Jul 21 04:10:00.891463 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.891424    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wsqst"]
Jul 21 04:10:00.928355 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.928315    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wsqst"]
Jul 21 04:10:00.928522 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.928441    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:00.931275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.931246    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 04:10:00.931275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.931273    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 04:10:00.932551 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.932529    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 04:10:00.932666 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.932578    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 04:10:00.932666 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.932614    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t87r9\""
Jul 21 04:10:00.975216 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.975181    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"]
Jul 21 04:10:00.994459 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.994427    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"]
Jul 21 04:10:00.994597 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.994541    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"
Jul 21 04:10:00.997410 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.997384    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 21 04:10:00.997524 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.997432    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rn6h9\""
Jul 21 04:10:00.997524 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:00.997384    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 21 04:10:01.058862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.058822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.058862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.058863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a4c0547-8eca-4817-9772-37e331110632-crio-socket\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.059067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.058977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a4c0547-8eca-4817-9772-37e331110632-data-volume\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.059067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.059007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnzsz\" (UniqueName: \"kubernetes.io/projected/4a4c0547-8eca-4817-9772-37e331110632-kube-api-access-hnzsz\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.059067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.059058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a4c0547-8eca-4817-9772-37e331110632-data-volume\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnzsz\" (UniqueName: \"kubernetes.io/projected/4a4c0547-8eca-4817-9772-37e331110632-kube-api-access-hnzsz\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.159645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.159865 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.159865 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159738    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tg4q\" (UniqueName: \"kubernetes.io/projected/0232f700-8b80-43d2-965c-18013d0d85fe-kube-api-access-4tg4q\") pod \"migrator-7cc9c7ffd7-fdv2v\" (UID: \"0232f700-8b80-43d2-965c-18013d0d85fe\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"
Jul 21 04:10:01.159865 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a4c0547-8eca-4817-9772-37e331110632-crio-socket\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.159953 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.159808    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:10:01.159987 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.159811    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:01.159987 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.159981    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:01.659960335 +0000 UTC m=+42.737174828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : configmap "kube-rbac-proxy" not found
Jul 21 04:10:01.160047 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a4c0547-8eca-4817-9772-37e331110632-crio-socket\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.160047 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.159960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a4c0547-8eca-4817-9772-37e331110632-data-volume\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.160047 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.160016    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:01.660000835 +0000 UTC m=+42.737215306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:01.172029 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.171995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnzsz\" (UniqueName: \"kubernetes.io/projected/4a4c0547-8eca-4817-9772-37e331110632-kube-api-access-hnzsz\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.260239 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.260199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tg4q\" (UniqueName: \"kubernetes.io/projected/0232f700-8b80-43d2-965c-18013d0d85fe-kube-api-access-4tg4q\") pod \"migrator-7cc9c7ffd7-fdv2v\" (UID: \"0232f700-8b80-43d2-965c-18013d0d85fe\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"
Jul 21 04:10:01.269887 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.269855    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tg4q\" (UniqueName: \"kubernetes.io/projected/0232f700-8b80-43d2-965c-18013d0d85fe-kube-api-access-4tg4q\") pod \"migrator-7cc9c7ffd7-fdv2v\" (UID: \"0232f700-8b80-43d2-965c-18013d0d85fe\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"
Jul 21 04:10:01.303945 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.303912    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"
Jul 21 04:10:01.448248 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.448191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v"]
Jul 21 04:10:01.450509 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:01.450485    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0232f700_8b80_43d2_965c_18013d0d85fe.slice/crio-3d1c4ba297a006f18290a4fae661f0e15d91d5fbf15d9f9766cd659f289e0d0f WatchSource:0}: Error finding container 3d1c4ba297a006f18290a4fae661f0e15d91d5fbf15d9f9766cd659f289e0d0f: Status 404 returned error can't find the container with id 3d1c4ba297a006f18290a4fae661f0e15d91d5fbf15d9f9766cd659f289e0d0f
Jul 21 04:10:01.663388 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.663351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.663563 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.663437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:01.663563 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.663499    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:01.663563 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.663516    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:10:01.663563 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.663561    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:02.663543749 +0000 UTC m=+43.740758233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:01.663694 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:01.663575    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:02.663569189 +0000 UTC m=+43.740783656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : configmap "kube-rbac-proxy" not found
Jul 21 04:10:01.671464 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:01.671435    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v" event={"ID":"0232f700-8b80-43d2-965c-18013d0d85fe","Type":"ContainerStarted","Data":"3d1c4ba297a006f18290a4fae661f0e15d91d5fbf15d9f9766cd659f289e0d0f"}
Jul 21 04:10:02.067250 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:02.067209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:10:02.067250 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:02.067258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:02.067684 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.067375    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:10:02.067684 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.067455    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls podName:3ad67e36-9907-4537-8973-ed2f3b244c96 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:10.067435882 +0000 UTC m=+51.144650348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls") pod "dns-default-5jsg4" (UID: "3ad67e36-9907-4537-8973-ed2f3b244c96") : secret "dns-default-metrics-tls" not found
Jul 21 04:10:02.067684 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.067378    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:10:02.067684 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.067491    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d544b846f-7mzjb: secret "image-registry-tls" not found
Jul 21 04:10:02.067684 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.067534    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls podName:9cbaaec4-51ec-4d31-a3e2-e90f96c990ea nodeName:}" failed. No retries permitted until 2026-07-21 04:10:10.067522569 +0000 UTC m=+51.144737048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls") pod "image-registry-6d544b846f-7mzjb" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea") : secret "image-registry-tls" not found
Jul 21 04:10:02.672421 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:02.672392    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:02.672608 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:02.672474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:02.672608 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.672531    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:10:02.672608 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.672590    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:02.672608 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.672610    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:04.672589665 +0000 UTC m=+45.749804136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : configmap "kube-rbac-proxy" not found
Jul 21 04:10:02.672862 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:02.672629    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:04.672618036 +0000 UTC m=+45.749832502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:02.674806 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:02.674787    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mcpdj_5d6cec48-d9db-4e69-bf64-f765409ebc21/dns-node-resolver/0.log"
Jul 21 04:10:03.273167 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.273140    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ql7lk_000e65b4-1400-44db-a04b-99509bd03df3/node-ca/0.log"
Jul 21 04:10:03.681038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.681003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v" event={"ID":"0232f700-8b80-43d2-965c-18013d0d85fe","Type":"ContainerStarted","Data":"9bf59de3c109b6890feb447c13fb8a316cead6c30d69b0f2b160105837af0fd9"}
Jul 21 04:10:03.681209 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.681096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v" event={"ID":"0232f700-8b80-43d2-965c-18013d0d85fe","Type":"ContainerStarted","Data":"4798a1ca75dc518bedfbb349a605b317e27235164ab95352f2a97be715aa8afc"}
Jul 21 04:10:03.700070 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.700022    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-fdv2v" podStartSLOduration=1.818025711 podStartE2EDuration="3.700006132s" totalImagesPullingTime="1.881980421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:03.699832958 +0000 UTC m=+44.777047448" watchObservedRunningTime="2026-07-21 04:10:03.700006132 +0000 UTC m=+44.777220660"
Jul 21 04:10:03.766769 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.766736    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-rdhn8"]
Jul 21 04:10:03.779657 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.779626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-rdhn8"]
Jul 21 04:10:03.779821 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.779739    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.782665 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.782639    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 04:10:03.782879 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.782640    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 04:10:03.783026 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.782824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/053740ff-961b-44f2-a028-88af328ce086-signing-key\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.783026 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.782851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qr8f2\""
Jul 21 04:10:03.783158 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.783030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2pm6\" (UniqueName: \"kubernetes.io/projected/053740ff-961b-44f2-a028-88af328ce086-kube-api-access-s2pm6\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.783158 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.783071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/053740ff-961b-44f2-a028-88af328ce086-signing-cabundle\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.783295 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.783196    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 04:10:03.783295 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.783271    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 04:10:03.884317 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.884275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/053740ff-961b-44f2-a028-88af328ce086-signing-key\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.884492 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.884355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2pm6\" (UniqueName: \"kubernetes.io/projected/053740ff-961b-44f2-a028-88af328ce086-kube-api-access-s2pm6\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.884492 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.884386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/053740ff-961b-44f2-a028-88af328ce086-signing-cabundle\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.885098 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.885077    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/053740ff-961b-44f2-a028-88af328ce086-signing-cabundle\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.886763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.886745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/053740ff-961b-44f2-a028-88af328ce086-signing-key\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:03.894047 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:03.894019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2pm6\" (UniqueName: \"kubernetes.io/projected/053740ff-961b-44f2-a028-88af328ce086-kube-api-access-s2pm6\") pod \"service-ca-58598695f7-rdhn8\" (UID: \"053740ff-961b-44f2-a028-88af328ce086\") " pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:04.076662 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:04.076618    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cfpnb_7af66331-9ca6-4122-88c8-1ffafc788501/serve-healthcheck-canary/0.log"
Jul 21 04:10:04.089090 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:04.089057    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-rdhn8"
Jul 21 04:10:04.226566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:04.226539    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-rdhn8"]
Jul 21 04:10:04.228889 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:04.228863    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053740ff_961b_44f2_a028_88af328ce086.slice/crio-676fe0f950087d76e0df988d6d90f0c5af1c833ef7d769ec0c35d96fb232e32e WatchSource:0}: Error finding container 676fe0f950087d76e0df988d6d90f0c5af1c833ef7d769ec0c35d96fb232e32e: Status 404 returned error can't find the container with id 676fe0f950087d76e0df988d6d90f0c5af1c833ef7d769ec0c35d96fb232e32e
Jul 21 04:10:04.684875 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:04.684839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-rdhn8" event={"ID":"053740ff-961b-44f2-a028-88af328ce086","Type":"ContainerStarted","Data":"676fe0f950087d76e0df988d6d90f0c5af1c833ef7d769ec0c35d96fb232e32e"}
Jul 21 04:10:04.691359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:04.691335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:04.691461 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:04.691408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:04.691517 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:04.691467    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:10:04.691517 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:04.691512    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:04.691610 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:04.691547    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:08.691525209 +0000 UTC m=+49.768739689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : configmap "kube-rbac-proxy" not found
Jul 21 04:10:04.691610 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:04.691569    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:08.691558732 +0000 UTC m=+49.768773205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:07.694067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:07.694022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-rdhn8" event={"ID":"053740ff-961b-44f2-a028-88af328ce086","Type":"ContainerStarted","Data":"ba05adc87826b0e41b00ca86d8ebc709f3dc74e078cbedd8afc6399c8fd6fdbb"}
Jul 21 04:10:07.711173 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:07.711123    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-rdhn8" podStartSLOduration=2.181319659 podStartE2EDuration="4.711106149s" totalImagesPullingTime="2.52978649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:07.71026277 +0000 UTC m=+48.787477251" watchObservedRunningTime="2026-07-21 04:10:07.711106149 +0000 UTC m=+48.788320638"
Jul 21 04:10:08.725942 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:08.725901    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:08.726377 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:08.726030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:08.726377 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:08.726054    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 04:10:08.726377 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:08.726135    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:08.726377 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:08.726138    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:16.726116407 +0000 UTC m=+57.803330893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : configmap "kube-rbac-proxy" not found
Jul 21 04:10:08.726377 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:08.726216    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls podName:4a4c0547-8eca-4817-9772-37e331110632 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:16.726199141 +0000 UTC m=+57.803413624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wsqst" (UID: "4a4c0547-8eca-4817-9772-37e331110632") : secret "insights-runtime-extractor-tls" not found
Jul 21 04:10:10.140077 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:10.140039    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:10.140463 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:10.140158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") pod \"image-registry-6d544b846f-7mzjb\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") " pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:10:10.140463 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:10.140185    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 04:10:10.140463 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:10.140249    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 04:10:10.140463 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:10.140262    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d544b846f-7mzjb: secret "image-registry-tls" not found
Jul 21 04:10:10.140463 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:10.140299    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls podName:3ad67e36-9907-4537-8973-ed2f3b244c96 nodeName:}" failed. No retries permitted until 2026-07-21 04:10:26.140277479 +0000 UTC m=+67.217491945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls") pod "dns-default-5jsg4" (UID: "3ad67e36-9907-4537-8973-ed2f3b244c96") : secret "dns-default-metrics-tls" not found
Jul 21 04:10:10.140463 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:10.140313    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls podName:9cbaaec4-51ec-4d31-a3e2-e90f96c990ea nodeName:}" failed. No retries permitted until 2026-07-21 04:10:26.140307823 +0000 UTC m=+67.217522290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls") pod "image-registry-6d544b846f-7mzjb" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea") : secret "image-registry-tls" not found
Jul 21 04:10:16.795626 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:16.795586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:16.796183 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:16.795689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:16.796263 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:16.796242    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4c0547-8eca-4817-9772-37e331110632-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:16.798180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:16.798156    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4c0547-8eca-4817-9772-37e331110632-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wsqst\" (UID: \"4a4c0547-8eca-4817-9772-37e331110632\") " pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:16.838249 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:16.838224    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wsqst"
Jul 21 04:10:16.964072 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:16.964028    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wsqst"]
Jul 21 04:10:17.721740 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:17.721631    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wsqst" event={"ID":"4a4c0547-8eca-4817-9772-37e331110632","Type":"ContainerStarted","Data":"1260fc333b00cbe042f69215206c721acf24623070130bba0e9c2f7399da8e50"}
Jul 21 04:10:20.642292 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:20.642261    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rvkgl"
Jul 21 04:10:22.738409 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:22.738367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wsqst" event={"ID":"4a4c0547-8eca-4817-9772-37e331110632","Type":"ContainerStarted","Data":"97efba6da02fe077c641ff6fea90971d854ea27af3aa634dfd25c3d3c7a5f0a7"}
Jul 21 04:10:24.367278 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.367239    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d544b846f-7mzjb"]
Jul 21 04:10:24.367704 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:10:24.367493    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d544b846f-7mzjb" podUID="9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"
Jul 21 04:10:24.386461 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.386419    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"]
Jul 21 04:10:24.405851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.405814    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"]
Jul 21 04:10:24.406031 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.405951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.409223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.409091    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 04:10:24.409223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.409214    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 04:10:24.409449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.409259    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 04:10:24.410218 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.410198    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cwr6n\""
Jul 21 04:10:24.410329 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.410225    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 04:10:24.411386 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.411363    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"]
Jul 21 04:10:24.411506 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.411392    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"]
Jul 21 04:10:24.411506 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.411474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.414076 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.414055    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 21 04:10:24.414191 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.414117    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 21 04:10:24.414252 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.414191    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 21 04:10:24.414337 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.414318    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 21 04:10:24.459380 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7dvg\" (UniqueName: \"kubernetes.io/projected/fe77638a-7e61-44be-94ad-75656dac2a5d-kube-api-access-k7dvg\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.459555 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-ca\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.459555 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b40507fc-7c58-473e-ad05-bd634b3ac00b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d7fd6c458-csxhl\" (UID: \"b40507fc-7c58-473e-ad05-bd634b3ac00b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.459555 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-hub\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.459555 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.459815 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.459815 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe77638a-7e61-44be-94ad-75656dac2a5d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.459815 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.459696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2st8\" (UniqueName: \"kubernetes.io/projected/b40507fc-7c58-473e-ad05-bd634b3ac00b-kube-api-access-x2st8\") pod \"managed-serviceaccount-addon-agent-6d7fd6c458-csxhl\" (UID: \"b40507fc-7c58-473e-ad05-bd634b3ac00b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.482986 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.482951    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cb5559c86-dbpfw"]
Jul 21 04:10:24.488322 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.488292    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.501038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.500993    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb5559c86-dbpfw"]
Jul 21 04:10:24.560517 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-bound-sa-token\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdt5l\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-kube-api-access-cdt5l\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.560729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe77638a-7e61-44be-94ad-75656dac2a5d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.560729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c539cce-c140-4756-a9f8-6857b6eb06a1-installation-pull-secrets\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560673    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2st8\" (UniqueName: \"kubernetes.io/projected/b40507fc-7c58-473e-ad05-bd634b3ac00b-kube-api-access-x2st8\") pod \"managed-serviceaccount-addon-agent-6d7fd6c458-csxhl\" (UID: \"b40507fc-7c58-473e-ad05-bd634b3ac00b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.560971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c539cce-c140-4756-a9f8-6857b6eb06a1-image-registry-private-configuration\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7dvg\" (UniqueName: \"kubernetes.io/projected/fe77638a-7e61-44be-94ad-75656dac2a5d-kube-api-access-k7dvg\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.560971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c539cce-c140-4756-a9f8-6857b6eb06a1-registry-certificates\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-registry-tls\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c539cce-c140-4756-a9f8-6857b6eb06a1-ca-trust-extracted\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.560971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.560954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-ca\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.561280 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.561011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b40507fc-7c58-473e-ad05-bd634b3ac00b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d7fd6c458-csxhl\" (UID: \"b40507fc-7c58-473e-ad05-bd634b3ac00b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.561280 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.561048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-hub\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.561280 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.561091    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.561280 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.561137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c539cce-c140-4756-a9f8-6857b6eb06a1-trusted-ca\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.561731 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.561654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe77638a-7e61-44be-94ad-75656dac2a5d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.563875 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.563828    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-hub\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.563875 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.563867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-ca\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.564052 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.563994    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.564147 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.564124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b40507fc-7c58-473e-ad05-bd634b3ac00b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d7fd6c458-csxhl\" (UID: \"b40507fc-7c58-473e-ad05-bd634b3ac00b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.564686 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.564645    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fe77638a-7e61-44be-94ad-75656dac2a5d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.572484 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.572458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7dvg\" (UniqueName: \"kubernetes.io/projected/fe77638a-7e61-44be-94ad-75656dac2a5d-kube-api-access-k7dvg\") pod \"cluster-proxy-proxy-agent-864cb7d7bb-hjtkn\" (UID: \"fe77638a-7e61-44be-94ad-75656dac2a5d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.572747 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.572701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2st8\" (UniqueName: \"kubernetes.io/projected/b40507fc-7c58-473e-ad05-bd634b3ac00b-kube-api-access-x2st8\") pod \"managed-serviceaccount-addon-agent-6d7fd6c458-csxhl\" (UID: \"b40507fc-7c58-473e-ad05-bd634b3ac00b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.661752 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.661657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-registry-tls\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.661752 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.661696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c539cce-c140-4756-a9f8-6857b6eb06a1-ca-trust-extracted\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.661968 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.661772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c539cce-c140-4756-a9f8-6857b6eb06a1-trusted-ca\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662029 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.661940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-bound-sa-token\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662140 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.662037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdt5l\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-kube-api-access-cdt5l\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662140 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.662081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c539cce-c140-4756-a9f8-6857b6eb06a1-installation-pull-secrets\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662242 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.662147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c539cce-c140-4756-a9f8-6857b6eb06a1-image-registry-private-configuration\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662242 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.662169    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c539cce-c140-4756-a9f8-6857b6eb06a1-ca-trust-extracted\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662242 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.662188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c539cce-c140-4756-a9f8-6857b6eb06a1-registry-certificates\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.662801 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.662773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c539cce-c140-4756-a9f8-6857b6eb06a1-trusted-ca\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.663099 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.663049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c539cce-c140-4756-a9f8-6857b6eb06a1-registry-certificates\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.664732 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.664635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-registry-tls\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.664863 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.664839    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c539cce-c140-4756-a9f8-6857b6eb06a1-installation-pull-secrets\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.665065 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.665047    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c539cce-c140-4756-a9f8-6857b6eb06a1-image-registry-private-configuration\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.678909 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.678886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-bound-sa-token\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.679199 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.679179    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdt5l\" (UniqueName: \"kubernetes.io/projected/5c539cce-c140-4756-a9f8-6857b6eb06a1-kube-api-access-cdt5l\") pod \"image-registry-7cb5559c86-dbpfw\" (UID: \"5c539cce-c140-4756-a9f8-6857b6eb06a1\") " pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.725002 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.724969    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"
Jul 21 04:10:24.732146 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.732116    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"
Jul 21 04:10:24.743237 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.743217    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:10:24.749765 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.749746    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:10:24.814736 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.814691    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jngx5\""
Jul 21 04:10:24.823120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.823088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:24.864763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-image-registry-private-configuration\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.864931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864773    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-installation-pull-secrets\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.864931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864820    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-ca-trust-extracted\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.864931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864850    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-bound-sa-token\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.864931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864871    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-trusted-ca\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.864931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864891    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-certificates\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.864931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.864925    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjdw7\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-kube-api-access-zjdw7\") pod \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\" (UID: \"9cbaaec4-51ec-4d31-a3e2-e90f96c990ea\") "
Jul 21 04:10:24.865421 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.865360    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:10:24.865593 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.865567    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:24.865922 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.865864    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:10:24.867421 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.867379    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:24.867557 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.867533    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:10:24.867640 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.867616    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:24.867694 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.867662    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-kube-api-access-zjdw7" (OuterVolumeSpecName: "kube-api-access-zjdw7") pod "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" (UID: "9cbaaec4-51ec-4d31-a3e2-e90f96c990ea"). InnerVolumeSpecName "kube-api-access-zjdw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:10:24.966359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966282    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-image-registry-private-configuration\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:24.966359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966315    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-installation-pull-secrets\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:24.966359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966326    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-ca-trust-extracted\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:24.966359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966335    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-bound-sa-token\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:24.966359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966345    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-trusted-ca\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:24.966359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966357    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-certificates\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:24.966634 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:24.966370    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjdw7\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-kube-api-access-zjdw7\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:25.067675 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.067637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:10:25.071066 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.070933    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 04:10:25.080795 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.080766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/625bb5d4-3d41-4cef-9765-cdf270e7a9a9-original-pull-secret\") pod \"global-pull-secret-syncer-fdtdh\" (UID: \"625bb5d4-3d41-4cef-9765-cdf270e7a9a9\") " pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:10:25.168330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.168293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:10:25.171355 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.171330    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 04:10:25.181055 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.181026    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dd1956a-3358-4238-afb8-7dae2afa9f72-metrics-certs\") pod \"network-metrics-daemon-ckbdx\" (UID: \"8dd1956a-3358-4238-afb8-7dae2afa9f72\") " pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:10:25.269818 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.269743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:10:25.272809 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.272771    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 04:10:25.283102 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.283080    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 04:10:25.294163 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.294140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pclxp\" (UniqueName: \"kubernetes.io/projected/78d694b8-2472-41a3-bf77-2794a4c0ff7a-kube-api-access-pclxp\") pod \"network-check-target-bdsg9\" (UID: \"78d694b8-2472-41a3-bf77-2794a4c0ff7a\") " pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:10:25.365722 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.365681    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fdtdh"
Jul 21 04:10:25.375946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.375924    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v8hm\""
Jul 21 04:10:25.380811 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.380790    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qwqtb\""
Jul 21 04:10:25.383120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.383101    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ckbdx"
Jul 21 04:10:25.388968 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.388947    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:10:25.627830 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.627691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl"]
Jul 21 04:10:25.641976 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.641910    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fdtdh"]
Jul 21 04:10:25.665384 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.665356    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn"]
Jul 21 04:10:25.668393 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:25.668371    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe77638a_7e61_44be_94ad_75656dac2a5d.slice/crio-5e03f5c5e5d127b2a684c515e1887d7ae69f95040bf9621ae16bc5a25d52a0cd WatchSource:0}: Error finding container 5e03f5c5e5d127b2a684c515e1887d7ae69f95040bf9621ae16bc5a25d52a0cd: Status 404 returned error can't find the container with id 5e03f5c5e5d127b2a684c515e1887d7ae69f95040bf9621ae16bc5a25d52a0cd
Jul 21 04:10:25.747048 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.747013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdtdh" event={"ID":"625bb5d4-3d41-4cef-9765-cdf270e7a9a9","Type":"ContainerStarted","Data":"2f094f4e63721699ccaa94d190cbd0f5315f949b26b64333fed4b3bd40b861d7"}
Jul 21 04:10:25.748788 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.748757    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wsqst" event={"ID":"4a4c0547-8eca-4817-9772-37e331110632","Type":"ContainerStarted","Data":"711d74d86c647939d58cb775647901192e286a26f12173a05cf0049a300788cd"}
Jul 21 04:10:25.749772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.749749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl" event={"ID":"b40507fc-7c58-473e-ad05-bd634b3ac00b","Type":"ContainerStarted","Data":"bc0789649d9afbf2d50a1b5f98c77cb3ccb965bf610170d23c0473af63c0493d"}
Jul 21 04:10:25.750854 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.750835    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d544b846f-7mzjb"
Jul 21 04:10:25.750946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.750851    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn" event={"ID":"fe77638a-7e61-44be-94ad-75656dac2a5d","Type":"ContainerStarted","Data":"5e03f5c5e5d127b2a684c515e1887d7ae69f95040bf9621ae16bc5a25d52a0cd"}
Jul 21 04:10:25.795294 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.795225    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d544b846f-7mzjb"]
Jul 21 04:10:25.797422 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.797399    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d544b846f-7mzjb"]
Jul 21 04:10:25.874225 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.874198    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea-registry-tls\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:10:25.894539 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.894502    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb5559c86-dbpfw"]
Jul 21 04:10:25.896905 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.896779    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ckbdx"]
Jul 21 04:10:25.897734 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:25.897693    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdsg9"]
Jul 21 04:10:25.897845 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:25.897825    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c539cce_c140_4756_a9f8_6857b6eb06a1.slice/crio-7235bf8cc63886dedac409081913f6b3c5176ecd0a1608ff6b8d34ed31a0112d WatchSource:0}: Error finding container 7235bf8cc63886dedac409081913f6b3c5176ecd0a1608ff6b8d34ed31a0112d: Status 404 returned error can't find the container with id 7235bf8cc63886dedac409081913f6b3c5176ecd0a1608ff6b8d34ed31a0112d
Jul 21 04:10:25.899261 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:25.899238    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd1956a_3358_4238_afb8_7dae2afa9f72.slice/crio-7c48d72d75a471399d3a7fe9a0a4990e41e807adb475b8f1433b4b5d864b5061 WatchSource:0}: Error finding container 7c48d72d75a471399d3a7fe9a0a4990e41e807adb475b8f1433b4b5d864b5061: Status 404 returned error can't find the container with id 7c48d72d75a471399d3a7fe9a0a4990e41e807adb475b8f1433b4b5d864b5061
Jul 21 04:10:25.900296 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:25.900183    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d694b8_2472_41a3_bf77_2794a4c0ff7a.slice/crio-499ea49ef75d894dd502b2ffe24c74e02102e217d7db97564520d07092ce424f WatchSource:0}: Error finding container 499ea49ef75d894dd502b2ffe24c74e02102e217d7db97564520d07092ce424f: Status 404 returned error can't find the container with id 499ea49ef75d894dd502b2ffe24c74e02102e217d7db97564520d07092ce424f
Jul 21 04:10:26.177834 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.177720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:26.180370 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.180331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ad67e36-9907-4537-8973-ed2f3b244c96-metrics-tls\") pod \"dns-default-5jsg4\" (UID: \"3ad67e36-9907-4537-8973-ed2f3b244c96\") " pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:26.416998 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.416949    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b7grb\""
Jul 21 04:10:26.425387 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.425354    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:26.616549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.616510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5jsg4"]
Jul 21 04:10:26.624836 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:26.624792    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad67e36_9907_4537_8973_ed2f3b244c96.slice/crio-a2dcddc5deb78646b9ffdbe85f888c1d05bf904a53eec837bfbf63beb213c386 WatchSource:0}: Error finding container a2dcddc5deb78646b9ffdbe85f888c1d05bf904a53eec837bfbf63beb213c386: Status 404 returned error can't find the container with id a2dcddc5deb78646b9ffdbe85f888c1d05bf904a53eec837bfbf63beb213c386
Jul 21 04:10:26.764374 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.764288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ckbdx" event={"ID":"8dd1956a-3358-4238-afb8-7dae2afa9f72","Type":"ContainerStarted","Data":"7c48d72d75a471399d3a7fe9a0a4990e41e807adb475b8f1433b4b5d864b5061"}
Jul 21 04:10:26.768837 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.768802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5jsg4" event={"ID":"3ad67e36-9907-4537-8973-ed2f3b244c96","Type":"ContainerStarted","Data":"a2dcddc5deb78646b9ffdbe85f888c1d05bf904a53eec837bfbf63beb213c386"}
Jul 21 04:10:26.778746 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.778720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdsg9" event={"ID":"78d694b8-2472-41a3-bf77-2794a4c0ff7a","Type":"ContainerStarted","Data":"499ea49ef75d894dd502b2ffe24c74e02102e217d7db97564520d07092ce424f"}
Jul 21 04:10:26.785289 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.785265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw" event={"ID":"5c539cce-c140-4756-a9f8-6857b6eb06a1","Type":"ContainerStarted","Data":"0432df72f86e5cb950b6439f496617998bbdab41f9ef20e4aa2392c811358435"}
Jul 21 04:10:26.785411 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.785307    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw" event={"ID":"5c539cce-c140-4756-a9f8-6857b6eb06a1","Type":"ContainerStarted","Data":"7235bf8cc63886dedac409081913f6b3c5176ecd0a1608ff6b8d34ed31a0112d"}
Jul 21 04:10:26.786074 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.786055    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:10:26.812871 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:26.811493    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw" podStartSLOduration=2.811475743 podStartE2EDuration="2.811475743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:26.811279486 +0000 UTC m=+67.888493977" watchObservedRunningTime="2026-07-21 04:10:26.811475743 +0000 UTC m=+67.888690214"
Jul 21 04:10:27.360595 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:27.360340    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cbaaec4-51ec-4d31-a3e2-e90f96c990ea" path="/var/lib/kubelet/pods/9cbaaec4-51ec-4d31-a3e2-e90f96c990ea/volumes"
Jul 21 04:10:36.832188 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.832151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn" event={"ID":"fe77638a-7e61-44be-94ad-75656dac2a5d","Type":"ContainerStarted","Data":"c5646aba7dde16da7874d9496615d39afeb1903db9eb8e96dddaa692f6868168"}
Jul 21 04:10:36.832672 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.832198    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn" event={"ID":"fe77638a-7e61-44be-94ad-75656dac2a5d","Type":"ContainerStarted","Data":"985b7421c2dca0db24e9e08fe694cf6191a3064d98184dc7c03c1c1d932c7c9f"}
Jul 21 04:10:36.832672 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.832214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn" event={"ID":"fe77638a-7e61-44be-94ad-75656dac2a5d","Type":"ContainerStarted","Data":"fb8b104fd87e7b13d9157941d85c92efaa6326b3e58a20ebc30582e9de214adb"}
Jul 21 04:10:36.833608 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.833582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fdtdh" event={"ID":"625bb5d4-3d41-4cef-9765-cdf270e7a9a9","Type":"ContainerStarted","Data":"ea836e7e3dd570cdb07606a96e63c34380acfb1e0272c4724f483388cde4c9d5"}
Jul 21 04:10:36.835224 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.835203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ckbdx" event={"ID":"8dd1956a-3358-4238-afb8-7dae2afa9f72","Type":"ContainerStarted","Data":"2d7944ac639c583394aa76e6943a543d7f589cc93195ededc394b9ab469f5ade"}
Jul 21 04:10:36.835332 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.835247    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ckbdx" event={"ID":"8dd1956a-3358-4238-afb8-7dae2afa9f72","Type":"ContainerStarted","Data":"37462c5c17987b140ff32e16115df938e33cd84740330df5503ba6fa8f6c53a3"}
Jul 21 04:10:36.837606 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.837578    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wsqst" event={"ID":"4a4c0547-8eca-4817-9772-37e331110632","Type":"ContainerStarted","Data":"8d68559c22612b301578df05e5c1179ddcdd8b5a21b834d528e155bb8a8a3cbc"}
Jul 21 04:10:36.839058 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.839032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl" event={"ID":"b40507fc-7c58-473e-ad05-bd634b3ac00b","Type":"ContainerStarted","Data":"46f0a820506e1633877e63b8b7546d4aa1fd7a9bebda58ef3244fee1cfb276a2"}
Jul 21 04:10:36.840904 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.840875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5jsg4" event={"ID":"3ad67e36-9907-4537-8973-ed2f3b244c96","Type":"ContainerStarted","Data":"087e84415d34e0fadb01e1204a1fec67f56a82bfa4401776e9c9f95a11423470"}
Jul 21 04:10:36.841018 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.840929    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:36.841018 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.840956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5jsg4" event={"ID":"3ad67e36-9907-4537-8973-ed2f3b244c96","Type":"ContainerStarted","Data":"856808ee505fc93d68870c3419e7a9978db0fd4c400218e626c56e7f7bf80a03"}
Jul 21 04:10:36.842941 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.842916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdsg9" event={"ID":"78d694b8-2472-41a3-bf77-2794a4c0ff7a","Type":"ContainerStarted","Data":"540abf0317d84e4f12f7f5fba243fec5c68e6d9085848bd90225a82e8a69eaf6"}
Jul 21 04:10:36.843063 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.843048    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:10:36.881068 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.881011    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5jsg4" podStartSLOduration=33.68305137 podStartE2EDuration="42.880994906s" totalImagesPullingTime="9.197943536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.879439992 +0000 UTC m=+77.956654481" watchObservedRunningTime="2026-07-21 04:10:36.880994906 +0000 UTC m=+77.958209395"
Jul 21 04:10:36.881202 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.881143    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-864cb7d7bb-hjtkn" podStartSLOduration=2.712289674 podStartE2EDuration="12.881137559s" totalImagesPullingTime="10.168847885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.856005173 +0000 UTC m=+77.933219664" watchObservedRunningTime="2026-07-21 04:10:36.881137559 +0000 UTC m=+77.958352026"
Jul 21 04:10:36.901671 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.901390    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wsqst" podStartSLOduration=18.268150188 podStartE2EDuration="36.901370115s" totalImagesPullingTime="18.633219927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:10:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.900851462 +0000 UTC m=+77.978065965" watchObservedRunningTime="2026-07-21 04:10:36.901370115 +0000 UTC m=+77.978584604"
Jul 21 04:10:36.915407 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.915359    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fdtdh" podStartSLOduration=66.720154255 podStartE2EDuration="1m16.91534174s" totalImagesPullingTime="10.195187485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.915320427 +0000 UTC m=+77.992534916" watchObservedRunningTime="2026-07-21 04:10:36.91534174 +0000 UTC m=+77.992556229"
Jul 21 04:10:36.934659 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.934622    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d7fd6c458-csxhl" podStartSLOduration=2.746114484 podStartE2EDuration="12.934608787s" totalImagesPullingTime="10.188494303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.934068507 +0000 UTC m=+78.011282997" watchObservedRunningTime="2026-07-21 04:10:36.934608787 +0000 UTC m=+78.011823267"
Jul 21 04:10:36.953217 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.953173    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ckbdx" podStartSLOduration=70.570307236 podStartE2EDuration="1m16.953160544s" totalImagesPullingTime="6.382853308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.952194642 +0000 UTC m=+78.029409151" watchObservedRunningTime="2026-07-21 04:10:36.953160544 +0000 UTC m=+78.030375033"
Jul 21 04:10:36.967756 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:36.967700    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bdsg9" podStartSLOduration=67.038306411 podStartE2EDuration="1m16.967687599s" totalImagesPullingTime="9.929381188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:36.967282807 +0000 UTC m=+78.044497295" watchObservedRunningTime="2026-07-21 04:10:36.967687599 +0000 UTC m=+78.044902084"
Jul 21 04:10:44.152693 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.152558    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5tgf7"]
Jul 21 04:10:44.158449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.158419    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.161367 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.161346    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 04:10:44.161608 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.161487    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zwp2w\""
Jul 21 04:10:44.161763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.161561    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 04:10:44.162498 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.162480    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 04:10:44.162498 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.162492    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 04:10:44.162659 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.162645    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 04:10:44.162788 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.162762    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 04:10:44.313053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/155aba9d-c1ca-4787-b1da-a23c33f68ab8-metrics-client-ca\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313307 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-textfile\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313307 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-wtmp\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313307 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313456 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-tls\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313456 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-root\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313456 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313372    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-sys\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.313456 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.313432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclr9\" (UniqueName: \"kubernetes.io/projected/155aba9d-c1ca-4787-b1da-a23c33f68ab8-kube-api-access-xclr9\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-wtmp\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414236 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-tls\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414330    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-root\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-sys\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-wtmp\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclr9\" (UniqueName: \"kubernetes.io/projected/155aba9d-c1ca-4787-b1da-a23c33f68ab8-kube-api-access-xclr9\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-sys\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414501 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/155aba9d-c1ca-4787-b1da-a23c33f68ab8-root\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414790 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/155aba9d-c1ca-4787-b1da-a23c33f68ab8-metrics-client-ca\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414790 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.414790 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.414683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-textfile\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.415136 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.415117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-textfile\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.415390 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.415362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/155aba9d-c1ca-4787-b1da-a23c33f68ab8-metrics-client-ca\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.415691 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.415673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.417051 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.417027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.417157 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.417101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/155aba9d-c1ca-4787-b1da-a23c33f68ab8-node-exporter-tls\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.423688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.423657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclr9\" (UniqueName: \"kubernetes.io/projected/155aba9d-c1ca-4787-b1da-a23c33f68ab8-kube-api-access-xclr9\") pod \"node-exporter-5tgf7\" (UID: \"155aba9d-c1ca-4787-b1da-a23c33f68ab8\") " pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.469669 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.469637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5tgf7"
Jul 21 04:10:44.483131 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:10:44.483100    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155aba9d_c1ca_4787_b1da_a23c33f68ab8.slice/crio-731cb62175a244c3f7a0ed7bb894930c2a41fa396fec09479c2ca6d8bb2f9df5 WatchSource:0}: Error finding container 731cb62175a244c3f7a0ed7bb894930c2a41fa396fec09479c2ca6d8bb2f9df5: Status 404 returned error can't find the container with id 731cb62175a244c3f7a0ed7bb894930c2a41fa396fec09479c2ca6d8bb2f9df5
Jul 21 04:10:44.828022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.827940    2567 patch_prober.go:28] interesting pod/image-registry-7cb5559c86-dbpfw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 04:10:44.828022 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.827993    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw" podUID="5c539cce-c140-4756-a9f8-6857b6eb06a1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 04:10:44.872243 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:44.872208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tgf7" event={"ID":"155aba9d-c1ca-4787-b1da-a23c33f68ab8","Type":"ContainerStarted","Data":"731cb62175a244c3f7a0ed7bb894930c2a41fa396fec09479c2ca6d8bb2f9df5"}
Jul 21 04:10:45.878090 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:45.878052    2567 generic.go:356] "Generic (PLEG): container finished" podID="155aba9d-c1ca-4787-b1da-a23c33f68ab8" containerID="fb3a332364857ecb7814175038d2bd5ff0ac11e5a77f4f97e4057f0ff382d739" exitCode=0
Jul 21 04:10:45.878566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:45.878111    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tgf7" event={"ID":"155aba9d-c1ca-4787-b1da-a23c33f68ab8","Type":"ContainerDied","Data":"fb3a332364857ecb7814175038d2bd5ff0ac11e5a77f4f97e4057f0ff382d739"}
Jul 21 04:10:46.849729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:46.849679    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5jsg4"
Jul 21 04:10:46.884638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:46.884602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tgf7" event={"ID":"155aba9d-c1ca-4787-b1da-a23c33f68ab8","Type":"ContainerStarted","Data":"85da1a1df27b78792c8c3abf9f0361771bedd959c795346554cf96b18fae509c"}
Jul 21 04:10:46.885035 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:46.884667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5tgf7" event={"ID":"155aba9d-c1ca-4787-b1da-a23c33f68ab8","Type":"ContainerStarted","Data":"ebe87d65deaa802ad5c0ce8b68b37afbe8812368897fcea9f306be62a76d4542"}
Jul 21 04:10:46.904420 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:46.904371    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5tgf7" podStartSLOduration=1.829696879 podStartE2EDuration="2.90435516s" totalImagesPullingTime="1.013139199s" totalInitContainerRuntime="61.519082ms" isStatefulPod=true podCreationTimestamp="2026-07-21 04:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:10:46.903700574 +0000 UTC m=+87.980915084" watchObservedRunningTime="2026-07-21 04:10:46.90435516 +0000 UTC m=+87.981569649"
Jul 21 04:10:48.803186 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:10:48.803155    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cb5559c86-dbpfw"
Jul 21 04:11:07.849357 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:11:07.849323    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bdsg9"
Jul 21 04:14:08.083806 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.083767    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"]
Jul 21 04:14:08.086855 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.086838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.090759 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.090730    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 04:14:08.090759 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.090754    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 04:14:08.090963 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.090739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sznh7\""
Jul 21 04:14:08.090963 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.090742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 04:14:08.091345 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.091328    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 04:14:08.103214 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.103189    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"]
Jul 21 04:14:08.175389 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.175347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31aadce4-ae55-450f-818e-a6a1058cd937-manifests\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.175389 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.175388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31aadce4-ae55-450f-818e-a6a1058cd937-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.175654 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.175475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31aadce4-ae55-450f-818e-a6a1058cd937-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.175654 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.175512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvtmk\" (UniqueName: \"kubernetes.io/projected/31aadce4-ae55-450f-818e-a6a1058cd937-kube-api-access-bvtmk\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.175654 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.175581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31aadce4-ae55-450f-818e-a6a1058cd937-tmp\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.276502 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.276406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31aadce4-ae55-450f-818e-a6a1058cd937-manifests\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.276502 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.276443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31aadce4-ae55-450f-818e-a6a1058cd937-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.276502 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.276484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31aadce4-ae55-450f-818e-a6a1058cd937-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.276502 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.276507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvtmk\" (UniqueName: \"kubernetes.io/projected/31aadce4-ae55-450f-818e-a6a1058cd937-kube-api-access-bvtmk\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.276875 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.276541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31aadce4-ae55-450f-818e-a6a1058cd937-tmp\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.276944 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.276886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31aadce4-ae55-450f-818e-a6a1058cd937-manifests\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.278843 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.278814    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31aadce4-ae55-450f-818e-a6a1058cd937-tmp\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.279049 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.279026    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31aadce4-ae55-450f-818e-a6a1058cd937-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.279090 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.279031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31aadce4-ae55-450f-818e-a6a1058cd937-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.286062 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.286041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvtmk\" (UniqueName: \"kubernetes.io/projected/31aadce4-ae55-450f-818e-a6a1058cd937-kube-api-access-bvtmk\") pod \"opendatahub-operator-controller-manager-7d877cbcc8-nk5pp\" (UID: \"31aadce4-ae55-450f-818e-a6a1058cd937\") " pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.397338 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.397300    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:08.529158 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.529035    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"]
Jul 21 04:14:08.531938 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:14:08.531912    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31aadce4_ae55_450f_818e_a6a1058cd937.slice/crio-d1ddc098d4244d0069e900cc5a600b4a763495c660fd4efc11f646cd5cb17e8d WatchSource:0}: Error finding container d1ddc098d4244d0069e900cc5a600b4a763495c660fd4efc11f646cd5cb17e8d: Status 404 returned error can't find the container with id d1ddc098d4244d0069e900cc5a600b4a763495c660fd4efc11f646cd5cb17e8d
Jul 21 04:14:08.544763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:08.544738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp" event={"ID":"31aadce4-ae55-450f-818e-a6a1058cd937","Type":"ContainerStarted","Data":"d1ddc098d4244d0069e900cc5a600b4a763495c660fd4efc11f646cd5cb17e8d"}
Jul 21 04:14:11.560993 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:11.560947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp" event={"ID":"31aadce4-ae55-450f-818e-a6a1058cd937","Type":"ContainerStarted","Data":"02de7225e58e0237230c2ee12e6e3cf06f46bc3dc326dc76cf6cf2f619891647"}
Jul 21 04:14:12.565682 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:12.565650    2567 generic.go:356] "Generic (PLEG): container finished" podID="31aadce4-ae55-450f-818e-a6a1058cd937" containerID="02de7225e58e0237230c2ee12e6e3cf06f46bc3dc326dc76cf6cf2f619891647" exitCode=0
Jul 21 04:14:12.566079 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:12.565700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp" event={"ID":"31aadce4-ae55-450f-818e-a6a1058cd937","Type":"ContainerDied","Data":"02de7225e58e0237230c2ee12e6e3cf06f46bc3dc326dc76cf6cf2f619891647"}
Jul 21 04:14:13.571030 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:13.570994    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp" event={"ID":"31aadce4-ae55-450f-818e-a6a1058cd937","Type":"ContainerStarted","Data":"0f2314f84920481ce40ac5c4ab37d7d4a5824c11f3686d171b2a5b348ae02f08"}
Jul 21 04:14:13.571406 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:13.571108    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:13.595205 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:13.595155    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp" podStartSLOduration=1.204671184 podStartE2EDuration="5.595139037s" totalImagesPullingTime="3.357179293s" totalInitContainerRuntime="1.03328856s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:13.593590565 +0000 UTC m=+294.670805054" watchObservedRunningTime="2026-07-21 04:14:13.595139037 +0000 UTC m=+294.672353525"
Jul 21 04:14:19.241356 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:19.241329    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 04:14:24.577625 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:24.577592    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d877cbcc8-nk5pp"
Jul 21 04:14:27.062580 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.062536    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"]
Jul 21 04:14:27.065321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.065298    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.068506 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.068484    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5wrmc\""
Jul 21 04:14:27.075090 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.075074    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 04:14:27.075674 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.075656    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 04:14:27.075772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.075755    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 04:14:27.075829 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.075788    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 04:14:27.092732 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.092690    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"]
Jul 21 04:14:27.116478 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.116448    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42a04508-e53a-4d55-9a8d-7bb7ee811a34-tmp\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.116583 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.116492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lhvg\" (UniqueName: \"kubernetes.io/projected/42a04508-e53a-4d55-9a8d-7bb7ee811a34-kube-api-access-8lhvg\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.116583 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.116569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a04508-e53a-4d55-9a8d-7bb7ee811a34-tls-certs\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.217747 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.217674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a04508-e53a-4d55-9a8d-7bb7ee811a34-tls-certs\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.217927 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.217781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42a04508-e53a-4d55-9a8d-7bb7ee811a34-tmp\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.217927 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.217800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lhvg\" (UniqueName: \"kubernetes.io/projected/42a04508-e53a-4d55-9a8d-7bb7ee811a34-kube-api-access-8lhvg\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.220088 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.220051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42a04508-e53a-4d55-9a8d-7bb7ee811a34-tmp\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.220270 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.220254    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a04508-e53a-4d55-9a8d-7bb7ee811a34-tls-certs\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.228012 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.227979    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lhvg\" (UniqueName: \"kubernetes.io/projected/42a04508-e53a-4d55-9a8d-7bb7ee811a34-kube-api-access-8lhvg\") pod \"kube-auth-proxy-757f6cbd6c-2rvk5\" (UID: \"42a04508-e53a-4d55-9a8d-7bb7ee811a34\") " pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.374106 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.374080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"
Jul 21 04:14:27.510188 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.510154    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5"]
Jul 21 04:14:27.513754 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:14:27.513729    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a04508_e53a_4d55_9a8d_7bb7ee811a34.slice/crio-76727d0032ad7f0f03e8f72b16b59c717aa49b2ce97e0522f848da10862d10a9 WatchSource:0}: Error finding container 76727d0032ad7f0f03e8f72b16b59c717aa49b2ce97e0522f848da10862d10a9: Status 404 returned error can't find the container with id 76727d0032ad7f0f03e8f72b16b59c717aa49b2ce97e0522f848da10862d10a9
Jul 21 04:14:27.515594 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.515579    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:14:27.620121 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:27.620087    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5" event={"ID":"42a04508-e53a-4d55-9a8d-7bb7ee811a34","Type":"ContainerStarted","Data":"76727d0032ad7f0f03e8f72b16b59c717aa49b2ce97e0522f848da10862d10a9"}
Jul 21 04:14:28.224464 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.224426    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m6lv4"]
Jul 21 04:14:28.227460 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.227430    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.230251 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.230104    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 04:14:28.230251 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.230211    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jzbls\""
Jul 21 04:14:28.238823 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.238794    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m6lv4"]
Jul 21 04:14:28.326906 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.326817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95aebd5a-9ab2-42aa-8119-fad59330af2f-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.326906 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.326875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zrkr\" (UniqueName: \"kubernetes.io/projected/95aebd5a-9ab2-42aa-8119-fad59330af2f-kube-api-access-5zrkr\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.427536 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.427495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95aebd5a-9ab2-42aa-8119-fad59330af2f-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.427768 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.427556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zrkr\" (UniqueName: \"kubernetes.io/projected/95aebd5a-9ab2-42aa-8119-fad59330af2f-kube-api-access-5zrkr\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.427768 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:14:28.427668    2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 21 04:14:28.427898 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:14:28.427779    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95aebd5a-9ab2-42aa-8119-fad59330af2f-tls-certs podName:95aebd5a-9ab2-42aa-8119-fad59330af2f nodeName:}" failed. No retries permitted until 2026-07-21 04:14:28.927756154 +0000 UTC m=+310.004970624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/95aebd5a-9ab2-42aa-8119-fad59330af2f-tls-certs") pod "model-serving-api-54d89bd5fc-m6lv4" (UID: "95aebd5a-9ab2-42aa-8119-fad59330af2f") : secret "model-serving-api-tls" not found
Jul 21 04:14:28.446521 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.446433    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zrkr\" (UniqueName: \"kubernetes.io/projected/95aebd5a-9ab2-42aa-8119-fad59330af2f-kube-api-access-5zrkr\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.931754 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.931698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95aebd5a-9ab2-42aa-8119-fad59330af2f-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:28.934771 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:28.934742    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95aebd5a-9ab2-42aa-8119-fad59330af2f-tls-certs\") pod \"model-serving-api-54d89bd5fc-m6lv4\" (UID: \"95aebd5a-9ab2-42aa-8119-fad59330af2f\") " pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:29.141958 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:29.141907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:29.730081 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:29.730058    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m6lv4"]
Jul 21 04:14:29.733085 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:14:29.733055    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95aebd5a_9ab2_42aa_8119_fad59330af2f.slice/crio-a6756675c734e5a2385ff54c0627db6b3a7b00ed27d408d23d51bede95a9ad7b WatchSource:0}: Error finding container a6756675c734e5a2385ff54c0627db6b3a7b00ed27d408d23d51bede95a9ad7b: Status 404 returned error can't find the container with id a6756675c734e5a2385ff54c0627db6b3a7b00ed27d408d23d51bede95a9ad7b
Jul 21 04:14:30.632553 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:30.632516    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5" event={"ID":"42a04508-e53a-4d55-9a8d-7bb7ee811a34","Type":"ContainerStarted","Data":"8dae145cd9890e637ffa426c4104beb16ba0cc1422a35a14b353f7223e43021d"}
Jul 21 04:14:30.633598 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:30.633575    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4" event={"ID":"95aebd5a-9ab2-42aa-8119-fad59330af2f","Type":"ContainerStarted","Data":"a6756675c734e5a2385ff54c0627db6b3a7b00ed27d408d23d51bede95a9ad7b"}
Jul 21 04:14:30.649838 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:30.649790    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-757f6cbd6c-2rvk5" podStartSLOduration=1.51081335 podStartE2EDuration="3.649774236s" totalImagesPullingTime="2.138960886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:30.649134627 +0000 UTC m=+311.726349116" watchObservedRunningTime="2026-07-21 04:14:30.649774236 +0000 UTC m=+311.726988775"
Jul 21 04:14:31.638360 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:31.638324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4" event={"ID":"95aebd5a-9ab2-42aa-8119-fad59330af2f","Type":"ContainerStarted","Data":"f55eb7497e4b8630e46515777ef40dc6dc12b902c4336236c7bca40258e528dc"}
Jul 21 04:14:31.638776 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:31.638413    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:31.656993 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:31.656942    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4" podStartSLOduration=2.247390144 podStartE2EDuration="3.656924711s" totalImagesPullingTime="1.409534567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:31.656485506 +0000 UTC m=+312.733699994" watchObservedRunningTime="2026-07-21 04:14:31.656924711 +0000 UTC m=+312.734139200"
Jul 21 04:14:33.575036 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.574999    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"]
Jul 21 04:14:33.578225 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.578201    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.581002 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.580975    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hhvcd\""
Jul 21 04:14:33.581134 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.581012    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 04:14:33.591488 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.591460    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"]
Jul 21 04:14:33.668748 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.668932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.668932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611af324-43e5-4226-9f0a-2749f974f842-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.668932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.668932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611af324-43e5-4226-9f0a-2749f974f842-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.668932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzpkd\" (UniqueName: \"kubernetes.io/projected/611af324-43e5-4226-9f0a-2749f974f842-kube-api-access-mzpkd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.669122 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.669122 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.669122 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.668994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611af324-43e5-4226-9f0a-2749f974f842-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.769848 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.769809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770039 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.769858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611af324-43e5-4226-9f0a-2749f974f842-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770039 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.769882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770039 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.769907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611af324-43e5-4226-9f0a-2749f974f842-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770039 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.769931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzpkd\" (UniqueName: \"kubernetes.io/projected/611af324-43e5-4226-9f0a-2749f974f842-kube-api-access-mzpkd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770266 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770266 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770266 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611af324-43e5-4226-9f0a-2749f974f842-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770266 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770467 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770467 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770424    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770623 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.770816 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.770797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/611af324-43e5-4226-9f0a-2749f974f842-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.772282 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.772259    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/611af324-43e5-4226-9f0a-2749f974f842-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.772400 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.772380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/611af324-43e5-4226-9f0a-2749f974f842-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.784925 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.784894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611af324-43e5-4226-9f0a-2749f974f842-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.785009 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.784965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzpkd\" (UniqueName: \"kubernetes.io/projected/611af324-43e5-4226-9f0a-2749f974f842-kube-api-access-mzpkd\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5qk6\" (UID: \"611af324-43e5-4226-9f0a-2749f974f842\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:33.888392 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:33.888361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:34.036081 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:34.036051    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"]
Jul 21 04:14:34.037582 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:14:34.037559    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611af324_43e5_4226_9f0a_2749f974f842.slice/crio-e4cee5929537aafc2125ed7ffea8ab68b46a2389f4b44eb40c1be1f7de784983 WatchSource:0}: Error finding container e4cee5929537aafc2125ed7ffea8ab68b46a2389f4b44eb40c1be1f7de784983: Status 404 returned error can't find the container with id e4cee5929537aafc2125ed7ffea8ab68b46a2389f4b44eb40c1be1f7de784983
Jul 21 04:14:34.652047 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:34.652002    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6" event={"ID":"611af324-43e5-4226-9f0a-2749f974f842","Type":"ContainerStarted","Data":"e4cee5929537aafc2125ed7ffea8ab68b46a2389f4b44eb40c1be1f7de784983"}
Jul 21 04:14:35.346276 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.346238    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"]
Jul 21 04:14:35.349781 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.349758    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.360067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.360045    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 04:14:35.360189 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.360046    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 04:14:35.361352 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.361320    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 04:14:35.361352 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.361345    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 04:14:35.361525 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.361461    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vpxss\""
Jul 21 04:14:35.361583 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.361567    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 04:14:35.364654 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.364635    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"]
Jul 21 04:14:35.383784 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.383744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/525bb684-0731-458a-b18c-e304621cd1f5-metrics-cert\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.383877 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.383800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsm88\" (UniqueName: \"kubernetes.io/projected/525bb684-0731-458a-b18c-e304621cd1f5-kube-api-access-fsm88\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.383877 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.383842    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/525bb684-0731-458a-b18c-e304621cd1f5-manager-config\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.384062 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.383999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/525bb684-0731-458a-b18c-e304621cd1f5-cert\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.484743 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.484700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/525bb684-0731-458a-b18c-e304621cd1f5-cert\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.484923 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.484767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/525bb684-0731-458a-b18c-e304621cd1f5-metrics-cert\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.484923 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.484798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsm88\" (UniqueName: \"kubernetes.io/projected/525bb684-0731-458a-b18c-e304621cd1f5-kube-api-access-fsm88\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.484923 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.484823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/525bb684-0731-458a-b18c-e304621cd1f5-manager-config\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.485485 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.485457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/525bb684-0731-458a-b18c-e304621cd1f5-manager-config\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.487235 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.487214    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/525bb684-0731-458a-b18c-e304621cd1f5-metrics-cert\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.487334 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.487275    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/525bb684-0731-458a-b18c-e304621cd1f5-cert\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.496104 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.496077    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsm88\" (UniqueName: \"kubernetes.io/projected/525bb684-0731-458a-b18c-e304621cd1f5-kube-api-access-fsm88\") pod \"lws-controller-manager-b844b6c94-fl94z\" (UID: \"525bb684-0731-458a-b18c-e304621cd1f5\") " pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:35.661765 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:35.661678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:36.527011 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.526970    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:14:36.527088 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.527065    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:14:36.527134 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.527111    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:14:36.607618 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.607592    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"]
Jul 21 04:14:36.609221 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:14:36.609195    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod525bb684_0731_458a_b18c_e304621cd1f5.slice/crio-517f53167d07549291d8f550fa2b5da918a1c65eb30c887359d825b6e07f3668 WatchSource:0}: Error finding container 517f53167d07549291d8f550fa2b5da918a1c65eb30c887359d825b6e07f3668: Status 404 returned error can't find the container with id 517f53167d07549291d8f550fa2b5da918a1c65eb30c887359d825b6e07f3668
Jul 21 04:14:36.662962 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.662926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z" event={"ID":"525bb684-0731-458a-b18c-e304621cd1f5","Type":"ContainerStarted","Data":"517f53167d07549291d8f550fa2b5da918a1c65eb30c887359d825b6e07f3668"}
Jul 21 04:14:36.664593 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.664563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6" event={"ID":"611af324-43e5-4226-9f0a-2749f974f842","Type":"ContainerStarted","Data":"e1c8f58449ab899e9f06e402c33f0d529cc3bf36229296b0d544c837ada3925f"}
Jul 21 04:14:36.725951 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.725847    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6" podStartSLOduration=1.238719773 podStartE2EDuration="3.725829892s" totalImagesPullingTime="2.487110119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:36.725035227 +0000 UTC m=+317.802249717" watchObservedRunningTime="2026-07-21 04:14:36.725829892 +0000 UTC m=+317.803044380"
Jul 21 04:14:36.888716 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:36.888681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:37.895132 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:37.895097    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:38.674169 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:38.674088    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:38.675328 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:38.675301    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5qk6"
Jul 21 04:14:39.678703 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:39.678602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z" event={"ID":"525bb684-0731-458a-b18c-e304621cd1f5","Type":"ContainerStarted","Data":"6e923937706b3e97e6b2b0d4ff67bb681fe30b62847e9802716c2f14bf47c2f1"}
Jul 21 04:14:39.679091 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:39.678784    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:14:39.697936 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:39.697868    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z" podStartSLOduration=1.9610365650000001 podStartE2EDuration="4.697853492s" totalImagesPullingTime="2.736816927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:14:39.697452901 +0000 UTC m=+320.774667389" watchObservedRunningTime="2026-07-21 04:14:39.697853492 +0000 UTC m=+320.775067981"
Jul 21 04:14:42.646144 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:42.646112    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-m6lv4"
Jul 21 04:14:50.685261 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:14:50.685232    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b844b6c94-fl94z"
Jul 21 04:17:28.633593 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.633560    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ng7c4"]
Jul 21 04:17:28.636476 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.636460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:28.639095 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.639073    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 04:17:28.639199 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.639073    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 04:17:28.640340 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.640320    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6lk6k\""
Jul 21 04:17:28.644876 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.644853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ng7c4"]
Jul 21 04:17:28.739991 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.739951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8br4\" (UniqueName: \"kubernetes.io/projected/cd10e0e2-d9a0-4b00-9001-20894102a8c1-kube-api-access-x8br4\") pod \"authorino-58cd955675-ng7c4\" (UID: \"cd10e0e2-d9a0-4b00-9001-20894102a8c1\") " pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:28.781206 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.781170    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4zp9"]
Jul 21 04:17:28.784242 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.784224    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:17:28.792511 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.792483    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4zp9"]
Jul 21 04:17:28.841166 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.841125    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8br4\" (UniqueName: \"kubernetes.io/projected/cd10e0e2-d9a0-4b00-9001-20894102a8c1-kube-api-access-x8br4\") pod \"authorino-58cd955675-ng7c4\" (UID: \"cd10e0e2-d9a0-4b00-9001-20894102a8c1\") " pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:28.853302 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.853276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8br4\" (UniqueName: \"kubernetes.io/projected/cd10e0e2-d9a0-4b00-9001-20894102a8c1-kube-api-access-x8br4\") pod \"authorino-58cd955675-ng7c4\" (UID: \"cd10e0e2-d9a0-4b00-9001-20894102a8c1\") " pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:28.942395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.942308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znkwl\" (UniqueName: \"kubernetes.io/projected/0d97ff57-e057-4c66-96f2-38dd52592f0f-kube-api-access-znkwl\") pod \"authorino-75d556bd77-j4zp9\" (UID: \"0d97ff57-e057-4c66-96f2-38dd52592f0f\") " pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:17:28.946245 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:28.946213    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:29.043414 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.043385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znkwl\" (UniqueName: \"kubernetes.io/projected/0d97ff57-e057-4c66-96f2-38dd52592f0f-kube-api-access-znkwl\") pod \"authorino-75d556bd77-j4zp9\" (UID: \"0d97ff57-e057-4c66-96f2-38dd52592f0f\") " pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:17:29.053013 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.052987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znkwl\" (UniqueName: \"kubernetes.io/projected/0d97ff57-e057-4c66-96f2-38dd52592f0f-kube-api-access-znkwl\") pod \"authorino-75d556bd77-j4zp9\" (UID: \"0d97ff57-e057-4c66-96f2-38dd52592f0f\") " pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:17:29.069986 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.069962    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ng7c4"]
Jul 21 04:17:29.071551 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:17:29.071522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd10e0e2_d9a0_4b00_9001_20894102a8c1.slice/crio-01348084f17036bf3fe3107feff9bde734362f4e901319d9217c3036197387c9 WatchSource:0}: Error finding container 01348084f17036bf3fe3107feff9bde734362f4e901319d9217c3036197387c9: Status 404 returned error can't find the container with id 01348084f17036bf3fe3107feff9bde734362f4e901319d9217c3036197387c9
Jul 21 04:17:29.093253 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.093228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:17:29.219410 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.219387    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4zp9"]
Jul 21 04:17:29.280999 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.280963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ng7c4" event={"ID":"cd10e0e2-d9a0-4b00-9001-20894102a8c1","Type":"ContainerStarted","Data":"01348084f17036bf3fe3107feff9bde734362f4e901319d9217c3036197387c9"}
Jul 21 04:17:29.282076 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:29.282050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4zp9" event={"ID":"0d97ff57-e057-4c66-96f2-38dd52592f0f","Type":"ContainerStarted","Data":"93ea42cb3ada068932a9ebfd09851453e6043670b428b1d693cd82b9a141c4e3"}
Jul 21 04:17:33.305859 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:33.305822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ng7c4" event={"ID":"cd10e0e2-d9a0-4b00-9001-20894102a8c1","Type":"ContainerStarted","Data":"9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35"}
Jul 21 04:17:33.307353 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:33.307330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4zp9" event={"ID":"0d97ff57-e057-4c66-96f2-38dd52592f0f","Type":"ContainerStarted","Data":"40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e"}
Jul 21 04:17:33.337925 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:33.337877    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ng7c4" podStartSLOduration=1.938612829 podStartE2EDuration="5.337861847s" totalImagesPullingTime="3.399249018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:33.337122882 +0000 UTC m=+494.414337371" watchObservedRunningTime="2026-07-21 04:17:33.337861847 +0000 UTC m=+494.415076335"
Jul 21 04:17:33.357960 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:33.357914    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-j4zp9" podStartSLOduration=2.116553467 podStartE2EDuration="5.357897691s" totalImagesPullingTime="3.241344224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:33.357190683 +0000 UTC m=+494.434405173" watchObservedRunningTime="2026-07-21 04:17:33.357897691 +0000 UTC m=+494.435112179"
Jul 21 04:17:33.403250 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:33.403218    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ng7c4"]
Jul 21 04:17:35.314912 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:35.314856    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ng7c4" podUID="cd10e0e2-d9a0-4b00-9001-20894102a8c1" containerName="authorino" containerID="cri-o://9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35" gracePeriod=30
Jul 21 04:17:35.550000 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:35.549969    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:35.696114 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:35.696076    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8br4\" (UniqueName: \"kubernetes.io/projected/cd10e0e2-d9a0-4b00-9001-20894102a8c1-kube-api-access-x8br4\") pod \"cd10e0e2-d9a0-4b00-9001-20894102a8c1\" (UID: \"cd10e0e2-d9a0-4b00-9001-20894102a8c1\") "
Jul 21 04:17:35.698359 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:35.698330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd10e0e2-d9a0-4b00-9001-20894102a8c1-kube-api-access-x8br4" (OuterVolumeSpecName: "kube-api-access-x8br4") pod "cd10e0e2-d9a0-4b00-9001-20894102a8c1" (UID: "cd10e0e2-d9a0-4b00-9001-20894102a8c1"). InnerVolumeSpecName "kube-api-access-x8br4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:35.796928 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:35.796881    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8br4\" (UniqueName: \"kubernetes.io/projected/cd10e0e2-d9a0-4b00-9001-20894102a8c1-kube-api-access-x8br4\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:17:36.319615 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.319578    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd10e0e2-d9a0-4b00-9001-20894102a8c1" containerID="9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35" exitCode=0
Jul 21 04:17:36.319615 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.319621    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ng7c4"
Jul 21 04:17:36.320180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.319666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ng7c4" event={"ID":"cd10e0e2-d9a0-4b00-9001-20894102a8c1","Type":"ContainerDied","Data":"9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35"}
Jul 21 04:17:36.320180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.319720    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ng7c4" event={"ID":"cd10e0e2-d9a0-4b00-9001-20894102a8c1","Type":"ContainerDied","Data":"01348084f17036bf3fe3107feff9bde734362f4e901319d9217c3036197387c9"}
Jul 21 04:17:36.320180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.319743    2567 scope.go:117] "RemoveContainer" containerID="9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35"
Jul 21 04:17:36.328054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.328039    2567 scope.go:117] "RemoveContainer" containerID="9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35"
Jul 21 04:17:36.328318 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:17:36.328299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35\": container with ID starting with 9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35 not found: ID does not exist" containerID="9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35"
Jul 21 04:17:36.328373 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.328326    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35"} err="failed to get container status \"9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35\": rpc error: code = NotFound desc = could not find container \"9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35\": container with ID starting with 9d4a999bd4780a60a3dac9c6edcd9debb288b410af8158cee9a90ecb21c45e35 not found: ID does not exist"
Jul 21 04:17:36.341404 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.341379    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ng7c4"]
Jul 21 04:17:36.347645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:36.347618    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ng7c4"]
Jul 21 04:17:37.356666 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:37.356633    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd10e0e2-d9a0-4b00-9001-20894102a8c1" path="/var/lib/kubelet/pods/cd10e0e2-d9a0-4b00-9001-20894102a8c1/volumes"
Jul 21 04:17:58.530827 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.530791    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4789d"]
Jul 21 04:17:58.531298 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.531108    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd10e0e2-d9a0-4b00-9001-20894102a8c1" containerName="authorino"
Jul 21 04:17:58.531298 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.531122    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd10e0e2-d9a0-4b00-9001-20894102a8c1" containerName="authorino"
Jul 21 04:17:58.531298 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.531177    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd10e0e2-d9a0-4b00-9001-20894102a8c1" containerName="authorino"
Jul 21 04:17:58.534031 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.534014    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:17:58.541666 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.541637    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4789d"]
Jul 21 04:17:58.581284 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.581253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sdc2\" (UniqueName: \"kubernetes.io/projected/a0029ba7-e333-49c7-9a6b-6a894b248c39-kube-api-access-8sdc2\") pod \"authorino-5d4b67c446-4789d\" (UID: \"a0029ba7-e333-49c7-9a6b-6a894b248c39\") " pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:17:58.682480 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.682443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sdc2\" (UniqueName: \"kubernetes.io/projected/a0029ba7-e333-49c7-9a6b-6a894b248c39-kube-api-access-8sdc2\") pod \"authorino-5d4b67c446-4789d\" (UID: \"a0029ba7-e333-49c7-9a6b-6a894b248c39\") " pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:17:58.692192 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.692165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sdc2\" (UniqueName: \"kubernetes.io/projected/a0029ba7-e333-49c7-9a6b-6a894b248c39-kube-api-access-8sdc2\") pod \"authorino-5d4b67c446-4789d\" (UID: \"a0029ba7-e333-49c7-9a6b-6a894b248c39\") " pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:17:58.759031 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.759003    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4789d"]
Jul 21 04:17:58.759256 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.759243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:17:58.785077 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.785010    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f8f5874b6-7hn98"]
Jul 21 04:17:58.788222 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.788206    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:17:58.796517 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.796492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8f5874b6-7hn98"]
Jul 21 04:17:58.883480 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.883444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqs9b\" (UniqueName: \"kubernetes.io/projected/a0cb7905-f6c9-45d1-b142-c489506e8607-kube-api-access-rqs9b\") pod \"authorino-7f8f5874b6-7hn98\" (UID: \"a0cb7905-f6c9-45d1-b142-c489506e8607\") " pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:17:58.884837 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.884819    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4789d"]
Jul 21 04:17:58.886561 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:17:58.886530    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0029ba7_e333_49c7_9a6b_6a894b248c39.slice/crio-b59e904a621b6ba08c6e58fca455803c3552220379323a43961a3c5074777660 WatchSource:0}: Error finding container b59e904a621b6ba08c6e58fca455803c3552220379323a43961a3c5074777660: Status 404 returned error can't find the container with id b59e904a621b6ba08c6e58fca455803c3552220379323a43961a3c5074777660
Jul 21 04:17:58.968892 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.968859    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f8f5874b6-7hn98"]
Jul 21 04:17:58.969101 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:17:58.969083    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rqs9b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7f8f5874b6-7hn98" podUID="a0cb7905-f6c9-45d1-b142-c489506e8607"
Jul 21 04:17:58.984806 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.984784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqs9b\" (UniqueName: \"kubernetes.io/projected/a0cb7905-f6c9-45d1-b142-c489506e8607-kube-api-access-rqs9b\") pod \"authorino-7f8f5874b6-7hn98\" (UID: \"a0cb7905-f6c9-45d1-b142-c489506e8607\") " pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:17:58.996403 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.996383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqs9b\" (UniqueName: \"kubernetes.io/projected/a0cb7905-f6c9-45d1-b142-c489506e8607-kube-api-access-rqs9b\") pod \"authorino-7f8f5874b6-7hn98\" (UID: \"a0cb7905-f6c9-45d1-b142-c489506e8607\") " pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:17:58.998217 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:58.998196    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9d75956bb-f5kx8"]
Jul 21 04:17:59.003064 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.003043    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.005444 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.005428    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 04:17:59.010977 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.010951    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9d75956bb-f5kx8"]
Jul 21 04:17:59.086164 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.086067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b592\" (UniqueName: \"kubernetes.io/projected/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-kube-api-access-6b592\") pod \"authorino-9d75956bb-f5kx8\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") " pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.086164 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.086126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-tls-cert\") pod \"authorino-9d75956bb-f5kx8\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") " pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.187426 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.187389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b592\" (UniqueName: \"kubernetes.io/projected/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-kube-api-access-6b592\") pod \"authorino-9d75956bb-f5kx8\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") " pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.187594 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.187458    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-tls-cert\") pod \"authorino-9d75956bb-f5kx8\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") " pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.189905 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.189886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-tls-cert\") pod \"authorino-9d75956bb-f5kx8\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") " pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.196593 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.196573    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b592\" (UniqueName: \"kubernetes.io/projected/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-kube-api-access-6b592\") pod \"authorino-9d75956bb-f5kx8\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") " pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.312358 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.312334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:17:59.409132 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.409093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4789d" event={"ID":"a0029ba7-e333-49c7-9a6b-6a894b248c39","Type":"ContainerStarted","Data":"b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85"}
Jul 21 04:17:59.409264 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.409153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4789d" event={"ID":"a0029ba7-e333-49c7-9a6b-6a894b248c39","Type":"ContainerStarted","Data":"b59e904a621b6ba08c6e58fca455803c3552220379323a43961a3c5074777660"}
Jul 21 04:17:59.409335 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.409282    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4789d" podUID="a0029ba7-e333-49c7-9a6b-6a894b248c39" containerName="authorino" containerID="cri-o://b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85" gracePeriod=30
Jul 21 04:17:59.409483 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.409464    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:17:59.419446 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.419425    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:17:59.427160 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.427116    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4789d" podStartSLOduration=1.068222804 podStartE2EDuration="1.427100201s" totalImagesPullingTime="358.877397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:17:59.425365349 +0000 UTC m=+520.502579840" watchObservedRunningTime="2026-07-21 04:17:59.427100201 +0000 UTC m=+520.504314689"
Jul 21 04:17:59.460302 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.460203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9d75956bb-f5kx8"]
Jul 21 04:17:59.463564 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:17:59.463537    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cf5e1aa_a920_4d97_a454_71c29b5c1c3b.slice/crio-bc2478aa35bc4899245b5bf319bc1c836a6c039686bc0ceb1e50e11ffc76aa88 WatchSource:0}: Error finding container bc2478aa35bc4899245b5bf319bc1c836a6c039686bc0ceb1e50e11ffc76aa88: Status 404 returned error can't find the container with id bc2478aa35bc4899245b5bf319bc1c836a6c039686bc0ceb1e50e11ffc76aa88
Jul 21 04:17:59.490014 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.489992    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqs9b\" (UniqueName: \"kubernetes.io/projected/a0cb7905-f6c9-45d1-b142-c489506e8607-kube-api-access-rqs9b\") pod \"a0cb7905-f6c9-45d1-b142-c489506e8607\" (UID: \"a0cb7905-f6c9-45d1-b142-c489506e8607\") "
Jul 21 04:17:59.491934 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.491907    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0cb7905-f6c9-45d1-b142-c489506e8607-kube-api-access-rqs9b" (OuterVolumeSpecName: "kube-api-access-rqs9b") pod "a0cb7905-f6c9-45d1-b142-c489506e8607" (UID: "a0cb7905-f6c9-45d1-b142-c489506e8607"). InnerVolumeSpecName "kube-api-access-rqs9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:59.591216 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.591186    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqs9b\" (UniqueName: \"kubernetes.io/projected/a0cb7905-f6c9-45d1-b142-c489506e8607-kube-api-access-rqs9b\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:17:59.643948 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.643922    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:17:59.691946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.691912    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sdc2\" (UniqueName: \"kubernetes.io/projected/a0029ba7-e333-49c7-9a6b-6a894b248c39-kube-api-access-8sdc2\") pod \"a0029ba7-e333-49c7-9a6b-6a894b248c39\" (UID: \"a0029ba7-e333-49c7-9a6b-6a894b248c39\") "
Jul 21 04:17:59.694006 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.693972    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0029ba7-e333-49c7-9a6b-6a894b248c39-kube-api-access-8sdc2" (OuterVolumeSpecName: "kube-api-access-8sdc2") pod "a0029ba7-e333-49c7-9a6b-6a894b248c39" (UID: "a0029ba7-e333-49c7-9a6b-6a894b248c39"). InnerVolumeSpecName "kube-api-access-8sdc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:17:59.792650 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:17:59.792607    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sdc2\" (UniqueName: \"kubernetes.io/projected/a0029ba7-e333-49c7-9a6b-6a894b248c39-kube-api-access-8sdc2\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:18:00.414021 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.413981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9d75956bb-f5kx8" event={"ID":"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b","Type":"ContainerStarted","Data":"d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74"}
Jul 21 04:18:00.414021 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.414034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9d75956bb-f5kx8" event={"ID":"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b","Type":"ContainerStarted","Data":"bc2478aa35bc4899245b5bf319bc1c836a6c039686bc0ceb1e50e11ffc76aa88"}
Jul 21 04:18:00.415207 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.415182    2567 generic.go:356] "Generic (PLEG): container finished" podID="a0029ba7-e333-49c7-9a6b-6a894b248c39" containerID="b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85" exitCode=0
Jul 21 04:18:00.415321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.415219    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4789d"
Jul 21 04:18:00.415321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.415228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8f5874b6-7hn98"
Jul 21 04:18:00.415321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.415252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4789d" event={"ID":"a0029ba7-e333-49c7-9a6b-6a894b248c39","Type":"ContainerDied","Data":"b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85"}
Jul 21 04:18:00.415321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.415279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4789d" event={"ID":"a0029ba7-e333-49c7-9a6b-6a894b248c39","Type":"ContainerDied","Data":"b59e904a621b6ba08c6e58fca455803c3552220379323a43961a3c5074777660"}
Jul 21 04:18:00.415321 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.415294    2567 scope.go:117] "RemoveContainer" containerID="b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85"
Jul 21 04:18:00.423867 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.423789    2567 scope.go:117] "RemoveContainer" containerID="b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85"
Jul 21 04:18:00.424098 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:18:00.424070    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85\": container with ID starting with b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85 not found: ID does not exist" containerID="b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85"
Jul 21 04:18:00.424191 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.424109    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85"} err="failed to get container status \"b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85\": rpc error: code = NotFound desc = could not find container \"b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85\": container with ID starting with b81924ce331a4a46ed504adebaf17caecd4810e67f304da211a0abe4ce2a4e85 not found: ID does not exist"
Jul 21 04:18:00.447824 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.447783    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9d75956bb-f5kx8" podStartSLOduration=2.128557853 podStartE2EDuration="2.447767288s" totalImagesPullingTime="319.209435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:18:00.43363645 +0000 UTC m=+521.510850940" watchObservedRunningTime="2026-07-21 04:18:00.447767288 +0000 UTC m=+521.524981777"
Jul 21 04:18:00.448958 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.448937    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4789d"]
Jul 21 04:18:00.457915 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.457891    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4789d"]
Jul 21 04:18:00.466381 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.466355    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4zp9"]
Jul 21 04:18:00.466556 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.466536    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-j4zp9" podUID="0d97ff57-e057-4c66-96f2-38dd52592f0f" containerName="authorino" containerID="cri-o://40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e" gracePeriod=30
Jul 21 04:18:00.481720 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.481682    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f8f5874b6-7hn98"]
Jul 21 04:18:00.489142 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.489111    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f8f5874b6-7hn98"]
Jul 21 04:18:00.710691 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.710670    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:18:00.800260 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.800226    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znkwl\" (UniqueName: \"kubernetes.io/projected/0d97ff57-e057-4c66-96f2-38dd52592f0f-kube-api-access-znkwl\") pod \"0d97ff57-e057-4c66-96f2-38dd52592f0f\" (UID: \"0d97ff57-e057-4c66-96f2-38dd52592f0f\") "
Jul 21 04:18:00.802199 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.802175    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d97ff57-e057-4c66-96f2-38dd52592f0f-kube-api-access-znkwl" (OuterVolumeSpecName: "kube-api-access-znkwl") pod "0d97ff57-e057-4c66-96f2-38dd52592f0f" (UID: "0d97ff57-e057-4c66-96f2-38dd52592f0f"). InnerVolumeSpecName "kube-api-access-znkwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:18:00.901407 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:00.901375    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znkwl\" (UniqueName: \"kubernetes.io/projected/0d97ff57-e057-4c66-96f2-38dd52592f0f-kube-api-access-znkwl\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:18:01.356780 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.356749    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0029ba7-e333-49c7-9a6b-6a894b248c39" path="/var/lib/kubelet/pods/a0029ba7-e333-49c7-9a6b-6a894b248c39/volumes"
Jul 21 04:18:01.357092 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.357065    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0cb7905-f6c9-45d1-b142-c489506e8607" path="/var/lib/kubelet/pods/a0cb7905-f6c9-45d1-b142-c489506e8607/volumes"
Jul 21 04:18:01.420123 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.420092    2567 generic.go:356] "Generic (PLEG): container finished" podID="0d97ff57-e057-4c66-96f2-38dd52592f0f" containerID="40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e" exitCode=0
Jul 21 04:18:01.420265 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.420132    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j4zp9"
Jul 21 04:18:01.420265 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.420169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4zp9" event={"ID":"0d97ff57-e057-4c66-96f2-38dd52592f0f","Type":"ContainerDied","Data":"40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e"}
Jul 21 04:18:01.420265 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.420210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j4zp9" event={"ID":"0d97ff57-e057-4c66-96f2-38dd52592f0f","Type":"ContainerDied","Data":"93ea42cb3ada068932a9ebfd09851453e6043670b428b1d693cd82b9a141c4e3"}
Jul 21 04:18:01.420265 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.420234    2567 scope.go:117] "RemoveContainer" containerID="40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e"
Jul 21 04:18:01.427866 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.427849    2567 scope.go:117] "RemoveContainer" containerID="40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e"
Jul 21 04:18:01.428089 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:18:01.428071    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e\": container with ID starting with 40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e not found: ID does not exist" containerID="40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e"
Jul 21 04:18:01.428146 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.428097    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e"} err="failed to get container status \"40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e\": rpc error: code = NotFound desc = could not find container \"40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e\": container with ID starting with 40e8272df8c185083e5c07a7bffc6cd5b5804674b25fe37a3c8285ab97bc798e not found: ID does not exist"
Jul 21 04:18:01.436529 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.436505    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4zp9"]
Jul 21 04:18:01.440762 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:01.440744    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j4zp9"]
Jul 21 04:18:03.357437 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:18:03.357406    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d97ff57-e057-4c66-96f2-38dd52592f0f" path="/var/lib/kubelet/pods/0d97ff57-e057-4c66-96f2-38dd52592f0f/volumes"
Jul 21 04:19:54.876256 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876174    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"]
Jul 21 04:19:54.878549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876444    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d97ff57-e057-4c66-96f2-38dd52592f0f" containerName="authorino"
Jul 21 04:19:54.878549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876454    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d97ff57-e057-4c66-96f2-38dd52592f0f" containerName="authorino"
Jul 21 04:19:54.878549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876472    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0029ba7-e333-49c7-9a6b-6a894b248c39" containerName="authorino"
Jul 21 04:19:54.878549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876477    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0029ba7-e333-49c7-9a6b-6a894b248c39" containerName="authorino"
Jul 21 04:19:54.878549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876521    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d97ff57-e057-4c66-96f2-38dd52592f0f" containerName="authorino"
Jul 21 04:19:54.878549 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.876530    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0029ba7-e333-49c7-9a6b-6a894b248c39" containerName="authorino"
Jul 21 04:19:54.879378 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.879363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:54.882064 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.882040    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 04:19:54.883510 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.883485    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 04:19:54.883618 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.883543    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 04:19:54.883618 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.883542    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ftzmb\""
Jul 21 04:19:54.888089 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.888065    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"]
Jul 21 04:19:54.932222 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.932170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:54.932222 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.932227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:54.932442 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.932280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb422d30-8b95-4c9a-9b32-fe599d224fbb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:54.932442 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.932298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:54.932442 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.932331    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:54.932442 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:54.932377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9hp\" (UniqueName: \"kubernetes.io/projected/bb422d30-8b95-4c9a-9b32-fe599d224fbb-kube-api-access-4n9hp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033197 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9hp\" (UniqueName: \"kubernetes.io/projected/bb422d30-8b95-4c9a-9b32-fe599d224fbb-kube-api-access-4n9hp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033211    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb422d30-8b95-4c9a-9b32-fe599d224fbb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033813 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033749    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033909 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.033909 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.033842    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.035613 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.035593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb422d30-8b95-4c9a-9b32-fe599d224fbb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.035936 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.035916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb422d30-8b95-4c9a-9b32-fe599d224fbb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.043002 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.042980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9hp\" (UniqueName: \"kubernetes.io/projected/bb422d30-8b95-4c9a-9b32-fe599d224fbb-kube-api-access-4n9hp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw\" (UID: \"bb422d30-8b95-4c9a-9b32-fe599d224fbb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.190580 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.190428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:19:55.322228 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.322204    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"]
Jul 21 04:19:55.324507 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:19:55.324480    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb422d30_8b95_4c9a_9b32_fe599d224fbb.slice/crio-d404ec9f44923448bb26c133d86824a37213faa9f54741abb4d3ada85b70982e WatchSource:0}: Error finding container d404ec9f44923448bb26c133d86824a37213faa9f54741abb4d3ada85b70982e: Status 404 returned error can't find the container with id d404ec9f44923448bb26c133d86824a37213faa9f54741abb4d3ada85b70982e
Jul 21 04:19:55.325750 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.325733    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:19:55.872864 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:55.872826    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw" event={"ID":"bb422d30-8b95-4c9a-9b32-fe599d224fbb","Type":"ContainerStarted","Data":"d404ec9f44923448bb26c133d86824a37213faa9f54741abb4d3ada85b70982e"}
Jul 21 04:19:56.879027 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:56.878991    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw" event={"ID":"bb422d30-8b95-4c9a-9b32-fe599d224fbb","Type":"ContainerStarted","Data":"928b5414d7053309d83861ccb368bea10c883e216281c95ce31c33154aeba94a"}
Jul 21 04:19:56.899480 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:19:56.899424    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw" podStartSLOduration=1.886190805 podStartE2EDuration="2.899393413s" totalImagesPullingTime="1.013202608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:19:56.897739222 +0000 UTC m=+637.974953735" watchObservedRunningTime="2026-07-21 04:19:56.899393413 +0000 UTC m=+637.976607902"
Jul 21 04:20:05.191109 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:05.191070    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:20:05.191528 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:05.191126    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:20:05.203428 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:05.203404    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:20:05.924120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:05.924086    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw"
Jul 21 04:20:10.477374 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.477342    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"]
Jul 21 04:20:10.480610 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.480594    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.483155 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.483132    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 04:20:10.492397 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.492374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"]
Jul 21 04:20:10.569904 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.569858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a2327f1-e2c9-4722-b562-82f2cc6ad900-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.570124 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.569924    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.570124 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.569997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97x9\" (UniqueName: \"kubernetes.io/projected/7a2327f1-e2c9-4722-b562-82f2cc6ad900-kube-api-access-j97x9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.570124 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.570048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.570124 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.570119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.570295 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.570141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a2327f1-e2c9-4722-b562-82f2cc6ad900-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671495 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671495 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97x9\" (UniqueName: \"kubernetes.io/projected/7a2327f1-e2c9-4722-b562-82f2cc6ad900-kube-api-access-j97x9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671495 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671473    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671676 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671676 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.671932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.672026 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.671981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.672026 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.672010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.673863 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.673832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a2327f1-e2c9-4722-b562-82f2cc6ad900-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.673999 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.673983    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a2327f1-e2c9-4722-b562-82f2cc6ad900-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.681170 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.681144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97x9\" (UniqueName: \"kubernetes.io/projected/7a2327f1-e2c9-4722-b562-82f2cc6ad900-kube-api-access-j97x9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hh8sh\" (UID: \"7a2327f1-e2c9-4722-b562-82f2cc6ad900\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.790179 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.790082    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:10.919794 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.919765    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"]
Jul 21 04:20:10.921970 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:20:10.921938    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2327f1_e2c9_4722_b562_82f2cc6ad900.slice/crio-ecd47fee75587471b5d036e1c23cc437754aacb1daed073efdefaa4dae963c9b WatchSource:0}: Error finding container ecd47fee75587471b5d036e1c23cc437754aacb1daed073efdefaa4dae963c9b: Status 404 returned error can't find the container with id ecd47fee75587471b5d036e1c23cc437754aacb1daed073efdefaa4dae963c9b
Jul 21 04:20:10.932268 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:10.932241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh" event={"ID":"7a2327f1-e2c9-4722-b562-82f2cc6ad900","Type":"ContainerStarted","Data":"ecd47fee75587471b5d036e1c23cc437754aacb1daed073efdefaa4dae963c9b"}
Jul 21 04:20:11.938087 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:11.938047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh" event={"ID":"7a2327f1-e2c9-4722-b562-82f2cc6ad900","Type":"ContainerStarted","Data":"c0c4a5007806962a4180e67c08427faa6ab6a809474cc0b76eff510eaee1621c"}
Jul 21 04:20:11.958660 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:11.958610    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh" podStartSLOduration=1.742475465 podStartE2EDuration="1.958594185s" totalImagesPullingTime="216.11872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:20:11.95672478 +0000 UTC m=+653.033939282" watchObservedRunningTime="2026-07-21 04:20:11.958594185 +0000 UTC m=+653.035808674"
Jul 21 04:20:20.790607 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.790565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:20.791053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.790638    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:20.802957 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.802929    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:20.881809 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.881771    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"]
Jul 21 04:20:20.884932 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.884916    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.887656 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.887636    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 04:20:20.898441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.898416    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"]
Jul 21 04:20:20.962756 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.962693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.962756 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.962760    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.962976 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.962864    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4x5z\" (UniqueName: \"kubernetes.io/projected/2d84a26c-a02e-4935-9277-c1bacdf56d29-kube-api-access-x4x5z\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.962976 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.962942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d84a26c-a02e-4935-9277-c1bacdf56d29-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.962976 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.962973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.963069 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.962993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:20.985112 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:20.985084    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hh8sh"
Jul 21 04:20:21.063483 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4x5z\" (UniqueName: \"kubernetes.io/projected/2d84a26c-a02e-4935-9277-c1bacdf56d29-kube-api-access-x4x5z\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.063483 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d84a26c-a02e-4935-9277-c1bacdf56d29-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.063690 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.063690 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.063690 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.063878 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.063973 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.064038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.063984    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.064117 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.064099    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.065847 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.065825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d84a26c-a02e-4935-9277-c1bacdf56d29-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.066023 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.066006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d84a26c-a02e-4935-9277-c1bacdf56d29-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.074003 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.073980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4x5z\" (UniqueName: \"kubernetes.io/projected/2d84a26c-a02e-4935-9277-c1bacdf56d29-kube-api-access-x4x5z\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t28hk\" (UID: \"2d84a26c-a02e-4935-9277-c1bacdf56d29\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.196252 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.196207    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:21.321570 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.321541    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"]
Jul 21 04:20:21.323787 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:20:21.323760    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d84a26c_a02e_4935_9277_c1bacdf56d29.slice/crio-928a6e37e68264aecc8e134a948d7f4897ece0a381d59c460dafca1165d7a3d5 WatchSource:0}: Error finding container 928a6e37e68264aecc8e134a948d7f4897ece0a381d59c460dafca1165d7a3d5: Status 404 returned error can't find the container with id 928a6e37e68264aecc8e134a948d7f4897ece0a381d59c460dafca1165d7a3d5
Jul 21 04:20:21.979538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.979503    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk" event={"ID":"2d84a26c-a02e-4935-9277-c1bacdf56d29","Type":"ContainerStarted","Data":"a449d5f75f43012bd70cb79250256c02ce84cd08cf8faba3ddb9a5cb18456895"}
Jul 21 04:20:21.979538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.979545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk" event={"ID":"2d84a26c-a02e-4935-9277-c1bacdf56d29","Type":"ContainerStarted","Data":"928a6e37e68264aecc8e134a948d7f4897ece0a381d59c460dafca1165d7a3d5"}
Jul 21 04:20:21.998350 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:21.998293    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk" podStartSLOduration=1.765673092 podStartE2EDuration="1.99827511s" totalImagesPullingTime="232.602018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:20:21.997751723 +0000 UTC m=+663.074966211" watchObservedRunningTime="2026-07-21 04:20:21.99827511 +0000 UTC m=+663.075489598"
Jul 21 04:20:31.196471 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:31.196427    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:31.197020 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:31.196738    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:31.209128 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:31.209101    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:20:32.033441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:20:32.033408    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t28hk"
Jul 21 04:21:17.357486 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.357451    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b7db74f5-sk2j5"]
Jul 21 04:21:17.360631 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.360611    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.368619 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.368593    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7db74f5-sk2j5"]
Jul 21 04:21:17.450449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.450405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10c34931-375b-4a3f-8c66-f0d3d64f0364-tls-cert\") pod \"authorino-5b7db74f5-sk2j5\" (UID: \"10c34931-375b-4a3f-8c66-f0d3d64f0364\") " pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.450623 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.450515    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swk4m\" (UniqueName: \"kubernetes.io/projected/10c34931-375b-4a3f-8c66-f0d3d64f0364-kube-api-access-swk4m\") pod \"authorino-5b7db74f5-sk2j5\" (UID: \"10c34931-375b-4a3f-8c66-f0d3d64f0364\") " pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.551419 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.551376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swk4m\" (UniqueName: \"kubernetes.io/projected/10c34931-375b-4a3f-8c66-f0d3d64f0364-kube-api-access-swk4m\") pod \"authorino-5b7db74f5-sk2j5\" (UID: \"10c34931-375b-4a3f-8c66-f0d3d64f0364\") " pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.551594 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.551453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10c34931-375b-4a3f-8c66-f0d3d64f0364-tls-cert\") pod \"authorino-5b7db74f5-sk2j5\" (UID: \"10c34931-375b-4a3f-8c66-f0d3d64f0364\") " pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.553933 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.553896    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10c34931-375b-4a3f-8c66-f0d3d64f0364-tls-cert\") pod \"authorino-5b7db74f5-sk2j5\" (UID: \"10c34931-375b-4a3f-8c66-f0d3d64f0364\") " pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.560811 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.560787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swk4m\" (UniqueName: \"kubernetes.io/projected/10c34931-375b-4a3f-8c66-f0d3d64f0364-kube-api-access-swk4m\") pod \"authorino-5b7db74f5-sk2j5\" (UID: \"10c34931-375b-4a3f-8c66-f0d3d64f0364\") " pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.670453 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.670362    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b7db74f5-sk2j5"
Jul 21 04:21:17.801964 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:17.801936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b7db74f5-sk2j5"]
Jul 21 04:21:17.804013 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:21:17.803986    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10c34931_375b_4a3f_8c66_f0d3d64f0364.slice/crio-946f5b4c2b0f51e99271dc17c62a1c3e8b803a63e6c652fc1078aa3fd8eefed3 WatchSource:0}: Error finding container 946f5b4c2b0f51e99271dc17c62a1c3e8b803a63e6c652fc1078aa3fd8eefed3: Status 404 returned error can't find the container with id 946f5b4c2b0f51e99271dc17c62a1c3e8b803a63e6c652fc1078aa3fd8eefed3
Jul 21 04:21:18.217771 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:18.217739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7db74f5-sk2j5" event={"ID":"10c34931-375b-4a3f-8c66-f0d3d64f0364","Type":"ContainerStarted","Data":"946f5b4c2b0f51e99271dc17c62a1c3e8b803a63e6c652fc1078aa3fd8eefed3"}
Jul 21 04:21:19.224971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.224937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b7db74f5-sk2j5" event={"ID":"10c34931-375b-4a3f-8c66-f0d3d64f0364","Type":"ContainerStarted","Data":"988f326a579e041dad25da294175bdec1ee59ded60d230652fcb2447941e0317"}
Jul 21 04:21:19.246267 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.246096    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b7db74f5-sk2j5" podStartSLOduration=1.8592270279999998 podStartE2EDuration="2.246069093s" totalImagesPullingTime="386.842065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:21:19.244995725 +0000 UTC m=+720.322210214" watchObservedRunningTime="2026-07-21 04:21:19.246069093 +0000 UTC m=+720.323283584"
Jul 21 04:21:19.273272 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.273238    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9d75956bb-f5kx8"]
Jul 21 04:21:19.273675 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.273627    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-9d75956bb-f5kx8" podUID="6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" containerName="authorino" containerID="cri-o://d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74" gracePeriod=30
Jul 21 04:21:19.536277 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.536246    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:21:19.673744 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.673690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b592\" (UniqueName: \"kubernetes.io/projected/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-kube-api-access-6b592\") pod \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") "
Jul 21 04:21:19.673920 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.673774    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-tls-cert\") pod \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\" (UID: \"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b\") "
Jul 21 04:21:19.675942 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.675882    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-kube-api-access-6b592" (OuterVolumeSpecName: "kube-api-access-6b592") pod "6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" (UID: "6cf5e1aa-a920-4d97-a454-71c29b5c1c3b"). InnerVolumeSpecName "kube-api-access-6b592". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:21:19.683447 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.683415    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" (UID: "6cf5e1aa-a920-4d97-a454-71c29b5c1c3b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:21:19.775572 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.775470    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b592\" (UniqueName: \"kubernetes.io/projected/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-kube-api-access-6b592\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:21:19.775572 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:19.775521    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b-tls-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:21:20.230638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.230598    2567 generic.go:356] "Generic (PLEG): container finished" podID="6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" containerID="d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74" exitCode=0
Jul 21 04:21:20.231120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.230638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9d75956bb-f5kx8" event={"ID":"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b","Type":"ContainerDied","Data":"d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74"}
Jul 21 04:21:20.231120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.230663    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9d75956bb-f5kx8"
Jul 21 04:21:20.231120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.230694    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9d75956bb-f5kx8" event={"ID":"6cf5e1aa-a920-4d97-a454-71c29b5c1c3b","Type":"ContainerDied","Data":"bc2478aa35bc4899245b5bf319bc1c836a6c039686bc0ceb1e50e11ffc76aa88"}
Jul 21 04:21:20.231120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.230734    2567 scope.go:117] "RemoveContainer" containerID="d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74"
Jul 21 04:21:20.239681 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.239660    2567 scope.go:117] "RemoveContainer" containerID="d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74"
Jul 21 04:21:20.240050 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:21:20.240029    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74\": container with ID starting with d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74 not found: ID does not exist" containerID="d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74"
Jul 21 04:21:20.240103 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.240061    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74"} err="failed to get container status \"d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74\": rpc error: code = NotFound desc = could not find container \"d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74\": container with ID starting with d1d82b63083defa37b46900dd231e44b00003c81c962e8deca0e2080220f0f74 not found: ID does not exist"
Jul 21 04:21:20.256389 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.256350    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9d75956bb-f5kx8"]
Jul 21 04:21:20.262911 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:20.262878    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9d75956bb-f5kx8"]
Jul 21 04:21:21.357470 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:21:21.357426    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" path="/var/lib/kubelet/pods/6cf5e1aa-a920-4d97-a454-71c29b5c1c3b/volumes"
Jul 21 04:37:44.980199 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.980113    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"]
Jul 21 04:37:44.980606 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.980404    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" containerName="authorino"
Jul 21 04:37:44.980606 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.980416    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" containerName="authorino"
Jul 21 04:37:44.980606 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.980479    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf5e1aa-a920-4d97-a454-71c29b5c1c3b" containerName="authorino"
Jul 21 04:37:44.983334 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.983315    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:44.991340 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.991315    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a261234a-openshift-default-dockercfg-pn5hk\""
Jul 21 04:37:44.999891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:44.999863    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"]
Jul 21 04:37:45.000308 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57b4efc5-af55-4611-8978-8ad5a9311389-istio-podinfo\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000419 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-credential-socket\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000419 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2f7w\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-kube-api-access-h2f7w\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000419 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-socket\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-envoy\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57b4efc5-af55-4611-8978-8ad5a9311389-istiod-ca-cert\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000566 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-data\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000689 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-certs\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.000689 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.000674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-istio-token\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.101782 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-envoy\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.101782 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57b4efc5-af55-4611-8978-8ad5a9311389-istiod-ca-cert\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102044 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-data\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102044 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-certs\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102044 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101880    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-istio-token\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102044 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101920    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57b4efc5-af55-4611-8978-8ad5a9311389-istio-podinfo\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102044 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101949    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-credential-socket\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102044 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.101981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2f7w\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-kube-api-access-h2f7w\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.102363    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-certs\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.102428    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-credential-socket\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.102426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-socket\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.102503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-data\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.102616    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57b4efc5-af55-4611-8978-8ad5a9311389-istiod-ca-cert\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.102729 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.102667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-socket\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.104108 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.104089    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-envoy\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.104388 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.104371    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57b4efc5-af55-4611-8978-8ad5a9311389-istio-podinfo\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.115638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.115608    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-istio-token\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.116059 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.116034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2f7w\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-kube-api-access-h2f7w\") pod \"e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") " pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.294261 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.294155    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:45.442347 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.442316    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"]
Jul 21 04:37:45.444252 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:37:45.444221    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b4efc5_af55_4611_8978_8ad5a9311389.slice/crio-9fc76ec1b65c772f639e3d7e3dcc943dc76435c439f73aafd2f71965c61bc2ea WatchSource:0}: Error finding container 9fc76ec1b65c772f639e3d7e3dcc943dc76435c439f73aafd2f71965c61bc2ea: Status 404 returned error can't find the container with id 9fc76ec1b65c772f639e3d7e3dcc943dc76435c439f73aafd2f71965c61bc2ea
Jul 21 04:37:45.446398 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.446361    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:37:45.446495 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.446445    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:37:45.446495 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:45.446488    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:37:46.310063 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:46.310030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" event={"ID":"57b4efc5-af55-4611-8978-8ad5a9311389","Type":"ContainerStarted","Data":"4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"}
Jul 21 04:37:46.310543 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:46.310090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" event={"ID":"57b4efc5-af55-4611-8978-8ad5a9311389","Type":"ContainerStarted","Data":"9fc76ec1b65c772f639e3d7e3dcc943dc76435c439f73aafd2f71965c61bc2ea"}
Jul 21 04:37:46.357684 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:46.357629    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" podStartSLOduration=2.357612851 podStartE2EDuration="2.357612851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:37:46.356945794 +0000 UTC m=+1707.434160284" watchObservedRunningTime="2026-07-21 04:37:46.357612851 +0000 UTC m=+1707.434827340"
Jul 21 04:37:47.294688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:47.294643    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:47.300606 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:47.300576    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:47.313772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:47.313745    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:37:47.314728 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:37:47.314684    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:02.315014 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.314977    2567 patch_prober.go:28] interesting pod/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 04:38:02.315437 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.315045    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 04:38:02.379935 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.379900    2567 generic.go:356] "Generic (PLEG): container finished" podID="57b4efc5-af55-4611-8978-8ad5a9311389" containerID="4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587" exitCode=0
Jul 21 04:38:02.380131 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.379961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" event={"ID":"57b4efc5-af55-4611-8978-8ad5a9311389","Type":"ContainerDied","Data":"4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"}
Jul 21 04:38:02.380377 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.380361    2567 scope.go:117] "RemoveContainer" containerID="4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"
Jul 21 04:38:02.381504 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.381473    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:38:02.381579 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.381562    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:38:02.381642 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:02.381624    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:38:03.386220 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:03.386188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" event={"ID":"57b4efc5-af55-4611-8978-8ad5a9311389","Type":"ContainerStarted","Data":"cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec"}
Jul 21 04:38:04.295173 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:04.295129    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:04.295403 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:04.295380    2567 patch_prober.go:28] interesting pod/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 04:38:04.295449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:04.295432    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 04:38:05.295117 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:05.295077    2567 patch_prober.go:28] interesting pod/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 04:38:05.295518 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:05.295134    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 04:38:06.295267 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:06.295229    2567 patch_prober.go:28] interesting pod/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 21 04:38:06.295663 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:06.295285    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 21 04:38:07.299937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:07.299908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:07.300456 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:07.300177    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:07.300867 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:07.300850    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:29.951632 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:29.951586    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"]
Jul 21 04:38:29.952267 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:29.951846    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy" containerID="cri-o://cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec" gracePeriod=30
Jul 21 04:38:35.194194 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.194165    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:35.250196 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250120    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-data\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250196 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57b4efc5-af55-4611-8978-8ad5a9311389-istio-podinfo\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250222    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-certs\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250380    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-envoy\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250515 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250415    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-istio-token\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250515 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250449    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-socket\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250515 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250457    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:35.250515 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250474    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57b4efc5-af55-4611-8978-8ad5a9311389-istiod-ca-cert\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250730 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250614    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-credential-socket\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250730 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250650    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2f7w\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-kube-api-access-h2f7w\") pod \"57b4efc5-af55-4611-8978-8ad5a9311389\" (UID: \"57b4efc5-af55-4611-8978-8ad5a9311389\") "
Jul 21 04:38:35.250730 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250667    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:35.250936 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250893    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57b4efc5-af55-4611-8978-8ad5a9311389-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:38:35.251073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:35.251073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.250986    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.251073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.251002    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-workload-socket\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.251073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.251015    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57b4efc5-af55-4611-8978-8ad5a9311389-istiod-ca-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.251073 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.251026    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-data" (OuterVolumeSpecName: "istio-data") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:35.252595 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.252569    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57b4efc5-af55-4611-8978-8ad5a9311389-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:38:35.252673 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.252617    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:38:35.252673 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.252636    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-istio-token" (OuterVolumeSpecName: "istio-token") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:38:35.252828 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.252792    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-kube-api-access-h2f7w" (OuterVolumeSpecName: "kube-api-access-h2f7w") pod "57b4efc5-af55-4611-8978-8ad5a9311389" (UID: "57b4efc5-af55-4611-8978-8ad5a9311389"). InnerVolumeSpecName "kube-api-access-h2f7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:38:35.351946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.351906    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-data\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.351946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.351937    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57b4efc5-af55-4611-8978-8ad5a9311389-istio-podinfo\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.351946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.351948    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-istio-envoy\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.352180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.351958    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-istio-token\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.352180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.351971    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57b4efc5-af55-4611-8978-8ad5a9311389-credential-socket\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.352180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.351983    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2f7w\" (UniqueName: \"kubernetes.io/projected/57b4efc5-af55-4611-8978-8ad5a9311389-kube-api-access-h2f7w\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:38:35.525038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.524942    2567 generic.go:356] "Generic (PLEG): container finished" podID="57b4efc5-af55-4611-8978-8ad5a9311389" containerID="cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec" exitCode=0
Jul 21 04:38:35.525038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.524996    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"
Jul 21 04:38:35.525038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.525025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" event={"ID":"57b4efc5-af55-4611-8978-8ad5a9311389","Type":"ContainerDied","Data":"cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec"}
Jul 21 04:38:35.525313 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.525084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v" event={"ID":"57b4efc5-af55-4611-8978-8ad5a9311389","Type":"ContainerDied","Data":"9fc76ec1b65c772f639e3d7e3dcc943dc76435c439f73aafd2f71965c61bc2ea"}
Jul 21 04:38:35.525313 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.525107    2567 scope.go:117] "RemoveContainer" containerID="cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec"
Jul 21 04:38:35.533857 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.533838    2567 scope.go:117] "RemoveContainer" containerID="4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"
Jul 21 04:38:35.543143 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.543115    2567 scope.go:117] "RemoveContainer" containerID="cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec"
Jul 21 04:38:35.543446 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:38:35.543421    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec\": container with ID starting with cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec not found: ID does not exist" containerID="cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec"
Jul 21 04:38:35.543560 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.543456    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec"} err="failed to get container status \"cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec\": rpc error: code = NotFound desc = could not find container \"cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec\": container with ID starting with cdec843913ef278470a57699ac0108eecf692bb137b64be16a180d77623c11ec not found: ID does not exist"
Jul 21 04:38:35.543560 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.543480    2567 scope.go:117] "RemoveContainer" containerID="4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"
Jul 21 04:38:35.543768 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:38:35.543749    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587\": container with ID starting with 4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587 not found: ID does not exist" containerID="4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"
Jul 21 04:38:35.543837 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.543776    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587"} err="failed to get container status \"4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587\": rpc error: code = NotFound desc = could not find container \"4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587\": container with ID starting with 4ad0ea401b6a9ed1e40f0bae0ee25c9b48ba9456e29b6f087a3545e169806587 not found: ID does not exist"
Jul 21 04:38:35.545081 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.545057    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"]
Jul 21 04:38:35.549950 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:35.549930    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a261234a-openshift-default-579ffdccf5-5m95v"]
Jul 21 04:38:37.357616 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:38:37.357581    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" path="/var/lib/kubelet/pods/57b4efc5-af55-4611-8978-8ad5a9311389/volumes"
Jul 21 04:42:17.163856 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.163822    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"]
Jul 21 04:42:17.167330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.164596    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy"
Jul 21 04:42:17.167330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.164671    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy"
Jul 21 04:42:17.167330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.164696    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy"
Jul 21 04:42:17.167330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.164787    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy"
Jul 21 04:42:17.167330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.165106    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy"
Jul 21 04:42:17.167330 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.165136    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b4efc5-af55-4611-8978-8ad5a9311389" containerName="istio-proxy"
Jul 21 04:42:17.169507 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.169483    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.172945 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.172922    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6ae222fa\"/\"kube-root-ca.crt\""
Jul 21 04:42:17.174281 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.174198    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6ae222fa\"/\"e2e-lifecycle-model-6ae222fa-kserve-self-signed-certs\""
Jul 21 04:42:17.174893 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.174252    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6ae222fa\"/\"openshift-service-ca.crt\""
Jul 21 04:42:17.174893 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.174308    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6ae222fa\"/\"default-dockercfg-pkl8g\""
Jul 21 04:42:17.176657 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.176634    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"]
Jul 21 04:42:17.271868 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.271831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-home\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.272053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.271882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60638226-93f5-4c65-9218-206b53a359a6-tls-certs\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.272053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.271957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-dshm\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.272053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.272008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-tmp-dir\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.272190 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.272053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zb44\" (UniqueName: \"kubernetes.io/projected/60638226-93f5-4c65-9218-206b53a359a6-kube-api-access-6zb44\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.272190 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.272083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-model-cache\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.372804 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.372769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-home\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373000 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.372830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60638226-93f5-4c65-9218-206b53a359a6-tls-certs\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373000 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.372865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-dshm\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373000 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.372895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-tmp-dir\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373189 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.373041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zb44\" (UniqueName: \"kubernetes.io/projected/60638226-93f5-4c65-9218-206b53a359a6-kube-api-access-6zb44\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373189 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.373086    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-model-cache\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373291 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.373183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-home\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373291 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.373230    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-tmp-dir\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.373454 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.373429    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-model-cache\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.375083 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.375057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-dshm\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.375343 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.375327    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60638226-93f5-4c65-9218-206b53a359a6-tls-certs\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.382883 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.382863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zb44\" (UniqueName: \"kubernetes.io/projected/60638226-93f5-4c65-9218-206b53a359a6-kube-api-access-6zb44\") pod \"e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") " pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.481598 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.481501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:17.611381 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:17.611349    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"]
Jul 21 04:42:17.613128 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:42:17.613086    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60638226_93f5_4c65_9218_206b53a359a6.slice/crio-961ee25997ae33d2f08f340f9137a63586576159d94d4cdc875db813e2553db3 WatchSource:0}: Error finding container 961ee25997ae33d2f08f340f9137a63586576159d94d4cdc875db813e2553db3: Status 404 returned error can't find the container with id 961ee25997ae33d2f08f340f9137a63586576159d94d4cdc875db813e2553db3
Jul 21 04:42:18.429594 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:18.429554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5" event={"ID":"60638226-93f5-4c65-9218-206b53a359a6","Type":"ContainerStarted","Data":"a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1"}
Jul 21 04:42:18.429594 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:18.429598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5" event={"ID":"60638226-93f5-4c65-9218-206b53a359a6","Type":"ContainerStarted","Data":"961ee25997ae33d2f08f340f9137a63586576159d94d4cdc875db813e2553db3"}
Jul 21 04:42:18.447013 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:18.446962    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5" podStartSLOduration=1.44694564 podStartE2EDuration="1.44694564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:42:18.446024661 +0000 UTC m=+1979.523239142" watchObservedRunningTime="2026-07-21 04:42:18.44694564 +0000 UTC m=+1979.524160128"
Jul 21 04:42:27.482081 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:27.482042    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:27.482483 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:27.482219    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:27.494692 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:27.494662    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:42:28.480866 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:42:28.480833    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:43:12.745653 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:12.745620    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"]
Jul 21 04:43:27.765426 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:27.765384    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5" podUID="60638226-93f5-4c65-9218-206b53a359a6" containerName="main" containerID="cri-o://a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1" gracePeriod=45
Jul 21 04:43:28.010101 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.010070    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:43:28.196130 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-tmp-dir\") pod \"60638226-93f5-4c65-9218-206b53a359a6\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") "
Jul 21 04:43:28.196337 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196145    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60638226-93f5-4c65-9218-206b53a359a6-tls-certs\") pod \"60638226-93f5-4c65-9218-206b53a359a6\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") "
Jul 21 04:43:28.196337 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196179    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-model-cache\") pod \"60638226-93f5-4c65-9218-206b53a359a6\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") "
Jul 21 04:43:28.196337 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196196    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-home\") pod \"60638226-93f5-4c65-9218-206b53a359a6\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") "
Jul 21 04:43:28.196337 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196212    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-dshm\") pod \"60638226-93f5-4c65-9218-206b53a359a6\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") "
Jul 21 04:43:28.196337 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196237    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zb44\" (UniqueName: \"kubernetes.io/projected/60638226-93f5-4c65-9218-206b53a359a6-kube-api-access-6zb44\") pod \"60638226-93f5-4c65-9218-206b53a359a6\" (UID: \"60638226-93f5-4c65-9218-206b53a359a6\") "
Jul 21 04:43:28.196576 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196445    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60638226-93f5-4c65-9218-206b53a359a6" (UID: "60638226-93f5-4c65-9218-206b53a359a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:28.196576 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196459    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-home" (OuterVolumeSpecName: "home") pod "60638226-93f5-4c65-9218-206b53a359a6" (UID: "60638226-93f5-4c65-9218-206b53a359a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:28.196576 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.196473    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "60638226-93f5-4c65-9218-206b53a359a6" (UID: "60638226-93f5-4c65-9218-206b53a359a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:28.198581 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.198547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60638226-93f5-4c65-9218-206b53a359a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60638226-93f5-4c65-9218-206b53a359a6" (UID: "60638226-93f5-4c65-9218-206b53a359a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:43:28.198688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.198614    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60638226-93f5-4c65-9218-206b53a359a6-kube-api-access-6zb44" (OuterVolumeSpecName: "kube-api-access-6zb44") pod "60638226-93f5-4c65-9218-206b53a359a6" (UID: "60638226-93f5-4c65-9218-206b53a359a6"). InnerVolumeSpecName "kube-api-access-6zb44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:43:28.198688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.198634    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-dshm" (OuterVolumeSpecName: "dshm") pod "60638226-93f5-4c65-9218-206b53a359a6" (UID: "60638226-93f5-4c65-9218-206b53a359a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:43:28.297852 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.297801    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-model-cache\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:43:28.297852 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.297847    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-home\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:43:28.297852 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.297856    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-dshm\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:43:28.297852 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.297865    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zb44\" (UniqueName: \"kubernetes.io/projected/60638226-93f5-4c65-9218-206b53a359a6-kube-api-access-6zb44\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:43:28.297852 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.297874    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60638226-93f5-4c65-9218-206b53a359a6-tmp-dir\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:43:28.298151 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.297884    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60638226-93f5-4c65-9218-206b53a359a6-tls-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:43:28.711350 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.711317    2567 generic.go:356] "Generic (PLEG): container finished" podID="60638226-93f5-4c65-9218-206b53a359a6" containerID="a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1" exitCode=0
Jul 21 04:43:28.711523 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.711361    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"
Jul 21 04:43:28.711523 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.711368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5" event={"ID":"60638226-93f5-4c65-9218-206b53a359a6","Type":"ContainerDied","Data":"a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1"}
Jul 21 04:43:28.711523 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.711400    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5" event={"ID":"60638226-93f5-4c65-9218-206b53a359a6","Type":"ContainerDied","Data":"961ee25997ae33d2f08f340f9137a63586576159d94d4cdc875db813e2553db3"}
Jul 21 04:43:28.711523 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.711416    2567 scope.go:117] "RemoveContainer" containerID="a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1"
Jul 21 04:43:28.720195 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.720172    2567 scope.go:117] "RemoveContainer" containerID="a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1"
Jul 21 04:43:28.720478 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:43:28.720455    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1\": container with ID starting with a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1 not found: ID does not exist" containerID="a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1"
Jul 21 04:43:28.720531 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.720487    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1"} err="failed to get container status \"a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1\": rpc error: code = NotFound desc = could not find container \"a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1\": container with ID starting with a1276ccf66dfa28d5e8e81f7ddfa0e9d97cf5d6a186958114ce0f4665f1fcde1 not found: ID does not exist"
Jul 21 04:43:28.734314 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.734286    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"]
Jul 21 04:43:28.741826 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:28.741799    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6ae222fa/e2e-lifecycle-model-6ae222fa-kserve-867656b7c5-m4mx5"]
Jul 21 04:43:29.357810 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:43:29.357779    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60638226-93f5-4c65-9218-206b53a359a6" path="/var/lib/kubelet/pods/60638226-93f5-4c65-9218-206b53a359a6/volumes"
Jul 21 04:45:00.212689 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.212644    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"]
Jul 21 04:45:00.213339 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.213153    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60638226-93f5-4c65-9218-206b53a359a6" containerName="main"
Jul 21 04:45:00.213339 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.213174    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="60638226-93f5-4c65-9218-206b53a359a6" containerName="main"
Jul 21 04:45:00.213339 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.213252    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="60638226-93f5-4c65-9218-206b53a359a6" containerName="main"
Jul 21 04:45:00.216292 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.216261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.218781 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.218757    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-97b818-openshift-default-dockercfg-8jw4h\""
Jul 21 04:45:00.228297 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.228258    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"]
Jul 21 04:45:00.317439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229v9\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-kube-api-access-229v9\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-certs\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-envoy\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-token\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317547    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-data\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istiod-ca-cert\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-socket\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-credential-socket\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.317761 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.317737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-podinfo\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.418893 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.418853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-credential-socket\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.418893 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.418904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-podinfo\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419140 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.418952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229v9\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-kube-api-access-229v9\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419140 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.418977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-certs\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419140 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-envoy\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419140 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-token\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419348 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-data\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419348 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istiod-ca-cert\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419348 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-credential-socket\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419489 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-certs\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419489 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419478    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-data\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.419735 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.419691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-socket\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.420129 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.420104    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istiod-ca-cert\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.420208 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.420115    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-socket\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.421577 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.421544    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-envoy\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.421833 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.421813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-podinfo\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.428135 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.428107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-token\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.428287 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.428268    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229v9\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-kube-api-access-229v9\") pod \"e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") " pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.529858 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.529761    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:00.669459 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.669425    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"]
Jul 21 04:45:00.671507 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:45:00.671473    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d11e33a_3f6f_425f_8424_00a88f6e37c8.slice/crio-78cbf5c0552331328a2b2f534af1258dcb25cd683a506d1d80bd35c2f5563925 WatchSource:0}: Error finding container 78cbf5c0552331328a2b2f534af1258dcb25cd683a506d1d80bd35c2f5563925: Status 404 returned error can't find the container with id 78cbf5c0552331328a2b2f534af1258dcb25cd683a506d1d80bd35c2f5563925
Jul 21 04:45:00.674277 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.674231    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:45:00.674386 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.674338    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:45:00.674444 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:00.674383    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:45:01.089328 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:01.089288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" event={"ID":"3d11e33a-3f6f-425f-8424-00a88f6e37c8","Type":"ContainerStarted","Data":"6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"}
Jul 21 04:45:01.089521 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:01.089345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" event={"ID":"3d11e33a-3f6f-425f-8424-00a88f6e37c8","Type":"ContainerStarted","Data":"78cbf5c0552331328a2b2f534af1258dcb25cd683a506d1d80bd35c2f5563925"}
Jul 21 04:45:01.112481 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:01.112433    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" podStartSLOduration=1.112416261 podStartE2EDuration="1.112416261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:45:01.11111535 +0000 UTC m=+2142.188329860" watchObservedRunningTime="2026-07-21 04:45:01.112416261 +0000 UTC m=+2142.189630750"
Jul 21 04:45:01.530303 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:01.530269    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:01.535395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:01.535367    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:02.094010 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:02.093973    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:02.094923 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:02.094904    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:16.159319 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:16.159285    2567 generic.go:356] "Generic (PLEG): container finished" podID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerID="6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997" exitCode=0
Jul 21 04:45:16.159763 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:16.159340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" event={"ID":"3d11e33a-3f6f-425f-8424-00a88f6e37c8","Type":"ContainerDied","Data":"6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"}
Jul 21 04:45:16.159834 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:16.159816    2567 scope.go:117] "RemoveContainer" containerID="6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"
Jul 21 04:45:16.160809 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:16.160778    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:45:16.160915 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:16.160846    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:45:16.160915 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:16.160881    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:45:17.094529 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:17.094484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:17.166670 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:17.166629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" event={"ID":"3d11e33a-3f6f-425f-8424-00a88f6e37c8","Type":"ContainerStarted","Data":"d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec"}
Jul 21 04:45:17.531028 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:17.530919    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:17.532281 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:17.532244    2567 patch_prober.go:28] interesting pod/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 21 04:45:17.532537 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:17.532503    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 21 04:45:18.530923 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:18.530876    2567 patch_prober.go:28] interesting pod/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 21 04:45:18.531436 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:18.530944    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 21 04:45:19.530481 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:19.530439    2567 patch_prober.go:28] interesting pod/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 21 04:45:19.530671 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:19.530512    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 21 04:45:20.531176 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:20.531138    2567 patch_prober.go:28] interesting pod/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 21 04:45:20.531829 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:20.531788    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 21 04:45:21.534644 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:21.534611    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:21.535119 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:21.534918    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:45:21.535590 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:45:21.535571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:47:07.058369 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:07.058289    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"]
Jul 21 04:47:07.058928 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:07.058542    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy" containerID="cri-o://d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec" gracePeriod=30
Jul 21 04:47:12.308975 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.308949    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:47:12.369674 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369644    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-229v9\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-kube-api-access-229v9\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.369891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-token\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.369891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369754    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-data\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.369891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369770    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-podinfo\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.369891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369810    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istiod-ca-cert\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.369891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369834    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-socket\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.370133 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369912    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-certs\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.370133 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.369939    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-credential-socket\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.370133 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370004    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-envoy\") pod \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\" (UID: \"3d11e33a-3f6f-425f-8424-00a88f6e37c8\") "
Jul 21 04:47:12.370287 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370131    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:12.370287 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370173    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:12.370402 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370301    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.370402 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370321    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-workload-socket\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.370402 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:12.370595 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370557    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:47:12.370778 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.370759    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:12.372188 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.372157    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-kube-api-access-229v9" (OuterVolumeSpecName: "kube-api-access-229v9") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "kube-api-access-229v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:12.372266 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.372203    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:47:12.372408 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.372383    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:47:12.372463 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.372442    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d11e33a-3f6f-425f-8424-00a88f6e37c8" (UID: "3d11e33a-3f6f-425f-8424-00a88f6e37c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:47:12.470999 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.470957    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istiod-ca-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.470999 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.470991    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-credential-socket\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.470999 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.471001    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-envoy\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.470999 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.471010    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-229v9\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-kube-api-access-229v9\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.471261 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.471020    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-token\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.471261 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.471029    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-data\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.471261 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.471036    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d11e33a-3f6f-425f-8424-00a88f6e37c8-istio-podinfo\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:47:12.641195 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.641101    2567 generic.go:356] "Generic (PLEG): container finished" podID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerID="d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec" exitCode=0
Jul 21 04:47:12.641195 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.641168    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"
Jul 21 04:47:12.641363 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.641187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" event={"ID":"3d11e33a-3f6f-425f-8424-00a88f6e37c8","Type":"ContainerDied","Data":"d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec"}
Jul 21 04:47:12.641363 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.641268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42" event={"ID":"3d11e33a-3f6f-425f-8424-00a88f6e37c8","Type":"ContainerDied","Data":"78cbf5c0552331328a2b2f534af1258dcb25cd683a506d1d80bd35c2f5563925"}
Jul 21 04:47:12.641363 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.641292    2567 scope.go:117] "RemoveContainer" containerID="d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec"
Jul 21 04:47:12.650668 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.650644    2567 scope.go:117] "RemoveContainer" containerID="6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"
Jul 21 04:47:12.658417 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.658399    2567 scope.go:117] "RemoveContainer" containerID="d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec"
Jul 21 04:47:12.658719 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:47:12.658688    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec\": container with ID starting with d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec not found: ID does not exist" containerID="d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec"
Jul 21 04:47:12.658772 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.658740    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec"} err="failed to get container status \"d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec\": rpc error: code = NotFound desc = could not find container \"d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec\": container with ID starting with d6a2afcdcbfa2276481ad35e2ba83e4e7929414e8bd1ecb9ba19c82f0fff33ec not found: ID does not exist"
Jul 21 04:47:12.658813 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.658773    2567 scope.go:117] "RemoveContainer" containerID="6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"
Jul 21 04:47:12.659005 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:47:12.658987    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997\": container with ID starting with 6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997 not found: ID does not exist" containerID="6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"
Jul 21 04:47:12.659046 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.659010    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997"} err="failed to get container status \"6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997\": rpc error: code = NotFound desc = could not find container \"6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997\": container with ID starting with 6d70d2bad3ab3e5ff63823f0f792c7d354d33bcca5ce3aefaeceee4f3f4ff997 not found: ID does not exist"
Jul 21 04:47:12.664354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.664322    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"]
Jul 21 04:47:12.668534 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:12.668513    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-97b818-openshift-default-9cf677b6f-z4v42"]
Jul 21 04:47:13.357612 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:13.357579    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" path="/var/lib/kubelet/pods/3d11e33a-3f6f-425f-8424-00a88f6e37c8/volumes"
Jul 21 04:47:16.114910 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.114847    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"]
Jul 21 04:47:16.115377 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.115327    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy"
Jul 21 04:47:16.115377 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.115345    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy"
Jul 21 04:47:16.115484 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.115445    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy"
Jul 21 04:47:16.115484 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.115460    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy"
Jul 21 04:47:16.119759 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.119738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.122427 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.122405    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-131f9d-openshift-default-dockercfg-zxq6z\""
Jul 21 04:47:16.131120 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.131094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"]
Jul 21 04:47:16.207546 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-socket\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207546 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207554    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-certs\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-envoy\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-data\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207682    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istiod-ca-cert\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-token\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvn88\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-kube-api-access-cvn88\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207769    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-podinfo\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.207862 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.207790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-credential-socket\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308430 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-socket\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308430 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-certs\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308560    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-envoy\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308688 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-data\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308838 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istiod-ca-cert\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308838 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308773    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-token\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.308838 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvn88\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-kube-api-access-cvn88\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309248 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-certs\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309248 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-socket\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309248 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.308962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-podinfo\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309248 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.309000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-credential-socket\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309429 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.309287    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-data\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309429 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.309310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-credential-socket\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.309518 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.309494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istiod-ca-cert\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.310996 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.310973    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-envoy\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.311263 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.311245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-podinfo\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.317631 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.317603    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-token\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.318430 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.318411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvn88\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-kube-api-access-cvn88\") pod \"e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") " pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.430234 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.430141    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:16.565756 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.565727    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"]
Jul 21 04:47:16.567880 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:47:16.567850    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8a80bd_76ba_43cf_864a_c78b793c3ff8.slice/crio-759410f00d5956f55600ca0247194920c67fafcab3185661f7e7c1a3c6944445 WatchSource:0}: Error finding container 759410f00d5956f55600ca0247194920c67fafcab3185661f7e7c1a3c6944445: Status 404 returned error can't find the container with id 759410f00d5956f55600ca0247194920c67fafcab3185661f7e7c1a3c6944445
Jul 21 04:47:16.570144 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.570107    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:47:16.570239 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.570222    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:47:16.570286 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.570271    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:47:16.660380 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.660339    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" event={"ID":"4b8a80bd-76ba-43cf-864a-c78b793c3ff8","Type":"ContainerStarted","Data":"74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"}
Jul 21 04:47:16.660551 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.660405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" event={"ID":"4b8a80bd-76ba-43cf-864a-c78b793c3ff8","Type":"ContainerStarted","Data":"759410f00d5956f55600ca0247194920c67fafcab3185661f7e7c1a3c6944445"}
Jul 21 04:47:16.680750 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:16.680620    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podStartSLOduration=0.680598879 podStartE2EDuration="680.598879ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:47:16.679760848 +0000 UTC m=+2277.756975353" watchObservedRunningTime="2026-07-21 04:47:16.680598879 +0000 UTC m=+2277.757813369"
Jul 21 04:47:17.431198 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:17.431156    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:17.435947 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:17.435921    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:17.664783 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:17.664749    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:17.665656 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:17.665634    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:32.667085 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.667043    2567 patch_prober.go:28] interesting pod/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 04:47:32.667573 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.667117    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 04:47:32.727618 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.727582    2567 generic.go:356] "Generic (PLEG): container finished" podID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerID="74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849" exitCode=0
Jul 21 04:47:32.727814 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.727653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" event={"ID":"4b8a80bd-76ba-43cf-864a-c78b793c3ff8","Type":"ContainerDied","Data":"74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"}
Jul 21 04:47:32.728117 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.728101    2567 scope.go:117] "RemoveContainer" containerID="74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"
Jul 21 04:47:32.729306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.729270    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:47:32.729421 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.729357    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:47:32.729421 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:32.729404    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"}
Jul 21 04:47:33.735581 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:33.735532    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" event={"ID":"4b8a80bd-76ba-43cf-864a-c78b793c3ff8","Type":"ContainerStarted","Data":"d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113"}
Jul 21 04:47:34.430891 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:34.430841    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:34.431232 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:34.431202    2567 patch_prober.go:28] interesting pod/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 04:47:34.431415 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:34.431389    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 04:47:35.431264 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:35.430766    2567 patch_prober.go:28] interesting pod/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 04:47:35.431264 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:35.430839    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 04:47:36.430733 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:36.430678    2567 patch_prober.go:28] interesting pod/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 04:47:36.430954 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:36.430776    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 04:47:37.430822 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:37.430782    2567 patch_prober.go:28] interesting pod/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 21 04:47:37.431483 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:37.431448    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 21 04:47:38.434687 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:38.434653    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:38.435152 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:38.435056    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:47:38.435804 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:47:38.435787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:48:24.971100 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:24.971063    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"]
Jul 21 04:48:24.971678 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:24.971283    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy" containerID="cri-o://d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113" gracePeriod=30
Jul 21 04:48:30.233613 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.233547    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:48:30.361297 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361247    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-envoy\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361311    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-data\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361361    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvn88\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-kube-api-access-cvn88\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361389    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-credential-socket\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361420    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-certs\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361466    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-podinfo\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361497    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-token\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361547    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-socket\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361597    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istiod-ca-cert\") pod \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\" (UID: \"4b8a80bd-76ba-43cf-864a-c78b793c3ff8\") "
Jul 21 04:48:30.361851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.361833    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:48:30.362049 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.362019    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:48:30.362112 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.362079    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:48:30.362170 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.362151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 04:48:30.362246 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.362222    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:48:30.363814 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.363766    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:48:30.363814 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.363795    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-kube-api-access-cvn88" (OuterVolumeSpecName: "kube-api-access-cvn88") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "kube-api-access-cvn88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:48:30.363991 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.363826    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 04:48:30.363991 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.363864    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b8a80bd-76ba-43cf-864a-c78b793c3ff8" (UID: "4b8a80bd-76ba-43cf-864a-c78b793c3ff8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:48:30.463204 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463152    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-podinfo\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463204 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463197    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-token\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463204 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463209    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-socket\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463458 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463221    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istiod-ca-cert\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463458 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463232    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-envoy\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463458 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463243    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-istio-data\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463458 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463255    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvn88\" (UniqueName: \"kubernetes.io/projected/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-kube-api-access-cvn88\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463458 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463269    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-credential-socket\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.463458 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.463282    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b8a80bd-76ba-43cf-864a-c78b793c3ff8-workload-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:48:30.980971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.980940    2567 generic.go:356] "Generic (PLEG): container finished" podID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerID="d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113" exitCode=0
Jul 21 04:48:30.981167 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.980992    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"
Jul 21 04:48:30.981167 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.981033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" event={"ID":"4b8a80bd-76ba-43cf-864a-c78b793c3ff8","Type":"ContainerDied","Data":"d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113"}
Jul 21 04:48:30.981167 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.981092    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7" event={"ID":"4b8a80bd-76ba-43cf-864a-c78b793c3ff8","Type":"ContainerDied","Data":"759410f00d5956f55600ca0247194920c67fafcab3185661f7e7c1a3c6944445"}
Jul 21 04:48:30.981167 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.981125    2567 scope.go:117] "RemoveContainer" containerID="d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113"
Jul 21 04:48:30.990512 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.990485    2567 scope.go:117] "RemoveContainer" containerID="74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"
Jul 21 04:48:30.998946 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.998922    2567 scope.go:117] "RemoveContainer" containerID="d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113"
Jul 21 04:48:30.999276 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:48:30.999255    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113\": container with ID starting with d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113 not found: ID does not exist" containerID="d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113"
Jul 21 04:48:30.999329 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.999286    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113"} err="failed to get container status \"d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113\": rpc error: code = NotFound desc = could not find container \"d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113\": container with ID starting with d01cef05c40370d1e2e46b34f1fe8ba0ebf22032520ba35e2c751fc405d33113 not found: ID does not exist"
Jul 21 04:48:30.999329 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.999306    2567 scope.go:117] "RemoveContainer" containerID="74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"
Jul 21 04:48:30.999565 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:48:30.999548    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849\": container with ID starting with 74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849 not found: ID does not exist" containerID="74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"
Jul 21 04:48:30.999607 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:30.999571    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849"} err="failed to get container status \"74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849\": rpc error: code = NotFound desc = could not find container \"74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849\": container with ID starting with 74570e76915125a9eb40af9d4dbac2fbe6c2ac3cb01cce02388319eea4eb7849 not found: ID does not exist"
Jul 21 04:48:31.004124 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:31.004090    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"]
Jul 21 04:48:31.007295 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:31.007264    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-131f9d-openshift-default-55bf588b49-92nm7"]
Jul 21 04:48:31.357322 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:48:31.357287    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" path="/var/lib/kubelet/pods/4b8a80bd-76ba-43cf-864a-c78b793c3ff8/volumes"
Jul 21 04:49:31.376861 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.376823    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"]
Jul 21 04:49:31.377275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.377114    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy"
Jul 21 04:49:31.377275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.377125    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d11e33a-3f6f-425f-8424-00a88f6e37c8" containerName="istio-proxy"
Jul 21 04:49:31.377275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.377143    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy"
Jul 21 04:49:31.377275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.377149    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy"
Jul 21 04:49:31.377275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.377202    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy"
Jul 21 04:49:31.377275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.377209    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy"
Jul 21 04:49:31.379989 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.379972    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.382683 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.382655    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"kube-root-ca.crt\""
Jul 21 04:49:31.383791 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.383773    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"default-dockercfg-c7hw8\""
Jul 21 04:49:31.383880 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.383773    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"auth-test-model-4de716-kserve-self-signed-certs\""
Jul 21 04:49:31.383880 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.383814    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"openshift-service-ca.crt\""
Jul 21 04:49:31.391117 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.391094    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"]
Jul 21 04:49:31.457345 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.457300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-dshm\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.457542 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.457356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-model-cache\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.457542 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.457378    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxj2z\" (UniqueName: \"kubernetes.io/projected/dfa0f5de-d3fa-463e-ba64-237fdd117472-kube-api-access-rxj2z\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.457542 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.457416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-tmp-dir\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.457542 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.457447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-home\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.457816 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.457577    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa0f5de-d3fa-463e-ba64-237fdd117472-tls-certs\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.558534 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.558490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-home\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.558773 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.558545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa0f5de-d3fa-463e-ba64-237fdd117472-tls-certs\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.558773 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.558583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-dshm\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.558773 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.558615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-model-cache\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.558773 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.558638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxj2z\" (UniqueName: \"kubernetes.io/projected/dfa0f5de-d3fa-463e-ba64-237fdd117472-kube-api-access-rxj2z\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.558773 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.558670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-tmp-dir\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.559054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.559020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-home\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.559098 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.559046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-model-cache\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.559132 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.559091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-tmp-dir\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.561020 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.560984    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-dshm\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.561172 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.561155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa0f5de-d3fa-463e-ba64-237fdd117472-tls-certs\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.568062 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.568040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxj2z\" (UniqueName: \"kubernetes.io/projected/dfa0f5de-d3fa-463e-ba64-237fdd117472-kube-api-access-rxj2z\") pod \"auth-test-model-4de716-kserve-f895bccd7-9j58b\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") " pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.689427 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.689329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:31.823075 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:31.823047    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"]
Jul 21 04:49:31.825739 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:49:31.825682    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfa0f5de_d3fa_463e_ba64_237fdd117472.slice/crio-317ceeb9283186d895745b9adb03368a31a7edf826fcf36fd796c95e51f7aee6 WatchSource:0}: Error finding container 317ceeb9283186d895745b9adb03368a31a7edf826fcf36fd796c95e51f7aee6: Status 404 returned error can't find the container with id 317ceeb9283186d895745b9adb03368a31a7edf826fcf36fd796c95e51f7aee6
Jul 21 04:49:32.234318 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:32.234277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b" event={"ID":"dfa0f5de-d3fa-463e-ba64-237fdd117472","Type":"ContainerStarted","Data":"910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b"}
Jul 21 04:49:32.234488 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:32.234328    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b" event={"ID":"dfa0f5de-d3fa-463e-ba64-237fdd117472","Type":"ContainerStarted","Data":"317ceeb9283186d895745b9adb03368a31a7edf826fcf36fd796c95e51f7aee6"}
Jul 21 04:49:32.254505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:32.254455    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b" podStartSLOduration=1.254439147 podStartE2EDuration="1.254439147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:49:32.253168877 +0000 UTC m=+2413.330383366" watchObservedRunningTime="2026-07-21 04:49:32.254439147 +0000 UTC m=+2413.331653673"
Jul 21 04:49:41.690195 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:41.690086    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:41.690195 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:41.690149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:41.702625 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:41.702596    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:49:42.284010 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:49:42.283968    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:51:40.170025 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:40.169987    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"]
Jul 21 04:51:45.379516 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.379479    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"]
Jul 21 04:51:45.379954 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.379795    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy"
Jul 21 04:51:45.379954 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.379807    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8a80bd-76ba-43cf-864a-c78b793c3ff8" containerName="istio-proxy"
Jul 21 04:51:45.382737 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.382700    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.385405 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.385378    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9fdb31\"/\"openshift-service-ca.crt\""
Jul 21 04:51:45.385405 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.385402    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9fdb31\"/\"kube-root-ca.crt\""
Jul 21 04:51:45.386700 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.386674    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9fdb31\"/\"default-dockercfg-cn5fg\""
Jul 21 04:51:45.386700 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.386691    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9fdb31\"/\"sub-test-model-9fdb31-kserve-self-signed-certs\""
Jul 21 04:51:45.390812 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.390782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"]
Jul 21 04:51:45.527502 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.527458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tls-certs\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.527502 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.527505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-home\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.527783 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.527580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tmp-dir\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.527783 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.527658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqzb8\" (UniqueName: \"kubernetes.io/projected/60f1025b-2216-49ef-9a3f-3346b17fe7aa-kube-api-access-gqzb8\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.527783 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.527690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-dshm\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.527783 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.527743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-model-cache\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628346 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tls-certs\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628477 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-home\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628477 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tmp-dir\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628477 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzb8\" (UniqueName: \"kubernetes.io/projected/60f1025b-2216-49ef-9a3f-3346b17fe7aa-kube-api-access-gqzb8\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628477 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-dshm\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628665 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-model-cache\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628892 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628864    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-home\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628966 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-model-cache\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.628966 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.628912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tmp-dir\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.631104 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.631044    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tls-certs\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.631104 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.631048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-dshm\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.637395 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.637371    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzb8\" (UniqueName: \"kubernetes.io/projected/60f1025b-2216-49ef-9a3f-3346b17fe7aa-kube-api-access-gqzb8\") pod \"sub-test-model-9fdb31-kserve-6898dc5569-5kk6h\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") " pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.692494 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.692451    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:45.824845 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:45.824815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"]
Jul 21 04:51:45.827024 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:51:45.826994    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60f1025b_2216_49ef_9a3f_3346b17fe7aa.slice/crio-69e45487f759b43030b4b2ad770b5cdc0e98c05cc5b3e2a4083333d8947f4369 WatchSource:0}: Error finding container 69e45487f759b43030b4b2ad770b5cdc0e98c05cc5b3e2a4083333d8947f4369: Status 404 returned error can't find the container with id 69e45487f759b43030b4b2ad770b5cdc0e98c05cc5b3e2a4083333d8947f4369
Jul 21 04:51:46.778145 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:46.778105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h" event={"ID":"60f1025b-2216-49ef-9a3f-3346b17fe7aa","Type":"ContainerStarted","Data":"b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794"}
Jul 21 04:51:46.778554 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:46.778153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h" event={"ID":"60f1025b-2216-49ef-9a3f-3346b17fe7aa","Type":"ContainerStarted","Data":"69e45487f759b43030b4b2ad770b5cdc0e98c05cc5b3e2a4083333d8947f4369"}
Jul 21 04:51:46.797421 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:46.797366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h" podStartSLOduration=1.7973502 podStartE2EDuration="1.7973502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:51:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:51:46.795851845 +0000 UTC m=+2547.873066335" watchObservedRunningTime="2026-07-21 04:51:46.7973502 +0000 UTC m=+2547.874564688"
Jul 21 04:51:55.190788 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.190731    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b" podUID="dfa0f5de-d3fa-463e-ba64-237fdd117472" containerName="main" containerID="cri-o://910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b" gracePeriod=45
Jul 21 04:51:55.439324 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.439297    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:51:55.514014 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.513925    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-home\") pod \"dfa0f5de-d3fa-463e-ba64-237fdd117472\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") "
Jul 21 04:51:55.514014 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.513971    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-tmp-dir\") pod \"dfa0f5de-d3fa-463e-ba64-237fdd117472\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") "
Jul 21 04:51:55.514245 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514025    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-model-cache\") pod \"dfa0f5de-d3fa-463e-ba64-237fdd117472\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") "
Jul 21 04:51:55.514245 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514057    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxj2z\" (UniqueName: \"kubernetes.io/projected/dfa0f5de-d3fa-463e-ba64-237fdd117472-kube-api-access-rxj2z\") pod \"dfa0f5de-d3fa-463e-ba64-237fdd117472\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") "
Jul 21 04:51:55.514245 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514081    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa0f5de-d3fa-463e-ba64-237fdd117472-tls-certs\") pod \"dfa0f5de-d3fa-463e-ba64-237fdd117472\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") "
Jul 21 04:51:55.514245 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514222    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-dshm\") pod \"dfa0f5de-d3fa-463e-ba64-237fdd117472\" (UID: \"dfa0f5de-d3fa-463e-ba64-237fdd117472\") "
Jul 21 04:51:55.514449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514263    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-home" (OuterVolumeSpecName: "home") pod "dfa0f5de-d3fa-463e-ba64-237fdd117472" (UID: "dfa0f5de-d3fa-463e-ba64-237fdd117472"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:51:55.514449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514315    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfa0f5de-d3fa-463e-ba64-237fdd117472" (UID: "dfa0f5de-d3fa-463e-ba64-237fdd117472"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:51:55.514449 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfa0f5de-d3fa-463e-ba64-237fdd117472" (UID: "dfa0f5de-d3fa-463e-ba64-237fdd117472"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:51:55.514588 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514541    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-home\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:51:55.514588 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514560    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-tmp-dir\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:51:55.514588 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.514574    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-model-cache\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:51:55.516315 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.516289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfa0f5de-d3fa-463e-ba64-237fdd117472-kube-api-access-rxj2z" (OuterVolumeSpecName: "kube-api-access-rxj2z") pod "dfa0f5de-d3fa-463e-ba64-237fdd117472" (UID: "dfa0f5de-d3fa-463e-ba64-237fdd117472"). InnerVolumeSpecName "kube-api-access-rxj2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:51:55.516404 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.516325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfa0f5de-d3fa-463e-ba64-237fdd117472-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfa0f5de-d3fa-463e-ba64-237fdd117472" (UID: "dfa0f5de-d3fa-463e-ba64-237fdd117472"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:51:55.516404 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.516325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-dshm" (OuterVolumeSpecName: "dshm") pod "dfa0f5de-d3fa-463e-ba64-237fdd117472" (UID: "dfa0f5de-d3fa-463e-ba64-237fdd117472"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:51:55.615987 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.615947    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxj2z\" (UniqueName: \"kubernetes.io/projected/dfa0f5de-d3fa-463e-ba64-237fdd117472-kube-api-access-rxj2z\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:51:55.615987 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.615983    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa0f5de-d3fa-463e-ba64-237fdd117472-tls-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:51:55.615987 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.615995    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa0f5de-d3fa-463e-ba64-237fdd117472-dshm\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:51:55.693415 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.693373    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:55.693572 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.693452    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:55.706099 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.706072    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:55.815097 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.815012    2567 generic.go:356] "Generic (PLEG): container finished" podID="dfa0f5de-d3fa-463e-ba64-237fdd117472" containerID="910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b" exitCode=0
Jul 21 04:51:55.815097 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.815059    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"
Jul 21 04:51:55.815275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.815100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b" event={"ID":"dfa0f5de-d3fa-463e-ba64-237fdd117472","Type":"ContainerDied","Data":"910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b"}
Jul 21 04:51:55.815275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.815148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b" event={"ID":"dfa0f5de-d3fa-463e-ba64-237fdd117472","Type":"ContainerDied","Data":"317ceeb9283186d895745b9adb03368a31a7edf826fcf36fd796c95e51f7aee6"}
Jul 21 04:51:55.815275 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.815170    2567 scope.go:117] "RemoveContainer" containerID="910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b"
Jul 21 04:51:55.823850 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.823826    2567 scope.go:117] "RemoveContainer" containerID="910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b"
Jul 21 04:51:55.824131 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:51:55.824103    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b\": container with ID starting with 910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b not found: ID does not exist" containerID="910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b"
Jul 21 04:51:55.824203 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.824143    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b"} err="failed to get container status \"910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b\": rpc error: code = NotFound desc = could not find container \"910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b\": container with ID starting with 910dc62d17c9cec3639887eea7e829843367cb3826969fd4f787d73276f4bc1b not found: ID does not exist"
Jul 21 04:51:55.827375 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.827354    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:51:55.837628 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.837602    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"]
Jul 21 04:51:55.841329 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:55.841306    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/auth-test-model-4de716-kserve-f895bccd7-9j58b"]
Jul 21 04:51:57.357512 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:51:57.357478    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfa0f5de-d3fa-463e-ba64-237fdd117472" path="/var/lib/kubelet/pods/dfa0f5de-d3fa-463e-ba64-237fdd117472/volumes"
Jul 21 04:53:38.499526 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:38.499491    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"]
Jul 21 04:53:53.519852 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.519784    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h" podUID="60f1025b-2216-49ef-9a3f-3346b17fe7aa" containerName="main" containerID="cri-o://b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794" gracePeriod=45
Jul 21 04:53:53.774553 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.774486    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:53:53.872344 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872310    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-dshm\") pod \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") "
Jul 21 04:53:53.872551 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872362    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tls-certs\") pod \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") "
Jul 21 04:53:53.872551 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872391    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-home\") pod \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") "
Jul 21 04:53:53.872673 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872617    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tmp-dir\") pod \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") "
Jul 21 04:53:53.872673 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872662    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-home" (OuterVolumeSpecName: "home") pod "60f1025b-2216-49ef-9a3f-3346b17fe7aa" (UID: "60f1025b-2216-49ef-9a3f-3346b17fe7aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:53.872808 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872674    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqzb8\" (UniqueName: \"kubernetes.io/projected/60f1025b-2216-49ef-9a3f-3346b17fe7aa-kube-api-access-gqzb8\") pod \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") "
Jul 21 04:53:53.872808 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872750    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-model-cache\") pod \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\" (UID: \"60f1025b-2216-49ef-9a3f-3346b17fe7aa\") "
Jul 21 04:53:53.872936 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.872908    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60f1025b-2216-49ef-9a3f-3346b17fe7aa" (UID: "60f1025b-2216-49ef-9a3f-3346b17fe7aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:53.873038 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.873013    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "60f1025b-2216-49ef-9a3f-3346b17fe7aa" (UID: "60f1025b-2216-49ef-9a3f-3346b17fe7aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:53.873137 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.873121    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tmp-dir\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:53:53.873194 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.873143    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-model-cache\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:53:53.873194 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.873158    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-home\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:53:53.874805 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.874772    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-dshm" (OuterVolumeSpecName: "dshm") pod "60f1025b-2216-49ef-9a3f-3346b17fe7aa" (UID: "60f1025b-2216-49ef-9a3f-3346b17fe7aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:53:53.874916 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.874808    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60f1025b-2216-49ef-9a3f-3346b17fe7aa" (UID: "60f1025b-2216-49ef-9a3f-3346b17fe7aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:53:53.874916 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.874871    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60f1025b-2216-49ef-9a3f-3346b17fe7aa-kube-api-access-gqzb8" (OuterVolumeSpecName: "kube-api-access-gqzb8") pod "60f1025b-2216-49ef-9a3f-3346b17fe7aa" (UID: "60f1025b-2216-49ef-9a3f-3346b17fe7aa"). InnerVolumeSpecName "kube-api-access-gqzb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:53:53.974496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.974457    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f1025b-2216-49ef-9a3f-3346b17fe7aa-tls-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:53:53.974496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.974491    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqzb8\" (UniqueName: \"kubernetes.io/projected/60f1025b-2216-49ef-9a3f-3346b17fe7aa-kube-api-access-gqzb8\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:53:53.974496 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:53.974501    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f1025b-2216-49ef-9a3f-3346b17fe7aa-dshm\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:53:54.301686 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.301652    2567 generic.go:356] "Generic (PLEG): container finished" podID="60f1025b-2216-49ef-9a3f-3346b17fe7aa" containerID="b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794" exitCode=0
Jul 21 04:53:54.301884 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.301693    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"
Jul 21 04:53:54.301884 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.301738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h" event={"ID":"60f1025b-2216-49ef-9a3f-3346b17fe7aa","Type":"ContainerDied","Data":"b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794"}
Jul 21 04:53:54.301884 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.301784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h" event={"ID":"60f1025b-2216-49ef-9a3f-3346b17fe7aa","Type":"ContainerDied","Data":"69e45487f759b43030b4b2ad770b5cdc0e98c05cc5b3e2a4083333d8947f4369"}
Jul 21 04:53:54.301884 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.301802    2567 scope.go:117] "RemoveContainer" containerID="b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794"
Jul 21 04:53:54.311515 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.311490    2567 scope.go:117] "RemoveContainer" containerID="b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794"
Jul 21 04:53:54.311876 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:53:54.311852    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794\": container with ID starting with b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794 not found: ID does not exist" containerID="b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794"
Jul 21 04:53:54.311961 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.311889    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794"} err="failed to get container status \"b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794\": rpc error: code = NotFound desc = could not find container \"b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794\": container with ID starting with b57a9ad8bc7d43889af3a61186194efb25f156500cc2b64965658e0343e11794 not found: ID does not exist"
Jul 21 04:53:54.324401 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.324370    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"]
Jul 21 04:53:54.328366 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:54.328335    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9fdb31/sub-test-model-9fdb31-kserve-6898dc5569-5kk6h"]
Jul 21 04:53:55.357645 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:53:55.357607    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60f1025b-2216-49ef-9a3f-3346b17fe7aa" path="/var/lib/kubelet/pods/60f1025b-2216-49ef-9a3f-3346b17fe7aa/volumes"
Jul 21 04:54:30.579605 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.579566    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"]
Jul 21 04:54:30.580040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.579895    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60f1025b-2216-49ef-9a3f-3346b17fe7aa" containerName="main"
Jul 21 04:54:30.580040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.579909    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="60f1025b-2216-49ef-9a3f-3346b17fe7aa" containerName="main"
Jul 21 04:54:30.580040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.579926    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfa0f5de-d3fa-463e-ba64-237fdd117472" containerName="main"
Jul 21 04:54:30.580040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.579932    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfa0f5de-d3fa-463e-ba64-237fdd117472" containerName="main"
Jul 21 04:54:30.580040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.579997    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfa0f5de-d3fa-463e-ba64-237fdd117472" containerName="main"
Jul 21 04:54:30.580040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.580007    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="60f1025b-2216-49ef-9a3f-3346b17fe7aa" containerName="main"
Jul 21 04:54:30.582793 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.582775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.586846 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.586823    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"kube-root-ca.crt\""
Jul 21 04:54:30.586846 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.586840    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"openshift-service-ca.crt\""
Jul 21 04:54:30.587024 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.586824    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"default-dockercfg-c7hw8\""
Jul 21 04:54:30.587024 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.586823    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4de716\"/\"rate-test-model-4de716-kserve-self-signed-certs\""
Jul 21 04:54:30.591969 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.591948    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"]
Jul 21 04:54:30.698293 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.698256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-home\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.698505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.698333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f902ac9c-a385-4e60-9083-b415ac1c1512-tls-certs\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.698505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.698367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-model-cache\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.698505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.698385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcpkv\" (UniqueName: \"kubernetes.io/projected/f902ac9c-a385-4e60-9083-b415ac1c1512-kube-api-access-pcpkv\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.698505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.698451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-tmp-dir\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.698505 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.698482    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-dshm\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.798955 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.798905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f902ac9c-a385-4e60-9083-b415ac1c1512-tls-certs\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.798955 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.798959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-model-cache\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799210 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcpkv\" (UniqueName: \"kubernetes.io/projected/f902ac9c-a385-4e60-9083-b415ac1c1512-kube-api-access-pcpkv\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799210 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-tmp-dir\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799210 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-dshm\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799210 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-home\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799428 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-model-cache\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799504 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799481    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-tmp-dir\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.799569 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.799551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-home\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.801441 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.801407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-dshm\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.801575 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.801556    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f902ac9c-a385-4e60-9083-b415ac1c1512-tls-certs\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.808784 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.808757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcpkv\" (UniqueName: \"kubernetes.io/projected/f902ac9c-a385-4e60-9083-b415ac1c1512-kube-api-access-pcpkv\") pod \"rate-test-model-4de716-kserve-75d89bf98c-6kxnz\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") " pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:30.892226 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:30.892174    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:31.026225 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:31.026199    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"]
Jul 21 04:54:31.028388 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:54:31.028357    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf902ac9c_a385_4e60_9083_b415ac1c1512.slice/crio-5b58d46cae83af31a256881325db99469a89333f5523c3de133ab4749a3913fe WatchSource:0}: Error finding container 5b58d46cae83af31a256881325db99469a89333f5523c3de133ab4749a3913fe: Status 404 returned error can't find the container with id 5b58d46cae83af31a256881325db99469a89333f5523c3de133ab4749a3913fe
Jul 21 04:54:31.468453 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:31.468415    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz" event={"ID":"f902ac9c-a385-4e60-9083-b415ac1c1512","Type":"ContainerStarted","Data":"5790f789bd4aadc6b43e2a5661d4e7637aa4c0f6f7e89e086332e6a09fed55fd"}
Jul 21 04:54:31.468659 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:31.468461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz" event={"ID":"f902ac9c-a385-4e60-9083-b415ac1c1512","Type":"ContainerStarted","Data":"5b58d46cae83af31a256881325db99469a89333f5523c3de133ab4749a3913fe"}
Jul 21 04:54:31.487243 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:31.487185    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz" podStartSLOduration=1.487170095 podStartE2EDuration="1.487170095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 04:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:54:31.486022401 +0000 UTC m=+2712.563236890" watchObservedRunningTime="2026-07-21 04:54:31.487170095 +0000 UTC m=+2712.564384583"
Jul 21 04:54:40.893158 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:40.893115    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:40.893668 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:40.893175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:40.905883 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:40.905852    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:54:41.521703 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:54:41.521671    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:55:12.580184 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:12.580152    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"]
Jul 21 04:55:13.607950 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.607914    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7799-140183462582576"]
Jul 21 04:55:13.611222 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.611203    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:13.614980 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.614955    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t7rfl\""
Jul 21 04:55:13.623876 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.623854    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462582576"]
Jul 21 04:55:13.687668 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.687626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zpg\" (UniqueName: \"kubernetes.io/projected/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2-kube-api-access-z9zpg\") pod \"test-curl-7799-140183462582576\" (UID: \"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2\") " pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:13.789090 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.789053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zpg\" (UniqueName: \"kubernetes.io/projected/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2-kube-api-access-z9zpg\") pod \"test-curl-7799-140183462582576\" (UID: \"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2\") " pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:13.798611 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.798578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zpg\" (UniqueName: \"kubernetes.io/projected/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2-kube-api-access-z9zpg\") pod \"test-curl-7799-140183462582576\" (UID: \"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2\") " pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:13.920273 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:13.920186    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:14.049152 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:14.049124    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462582576"]
Jul 21 04:55:14.051534 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:55:14.051500    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod488c3a53_ba9e_4334_b4a1_6d40bb7bbce2.slice/crio-c8bcbf97bf0fb37bc2b883954acccd78ed4ae5d88b33b878f2311c4ca7d8f99d WatchSource:0}: Error finding container c8bcbf97bf0fb37bc2b883954acccd78ed4ae5d88b33b878f2311c4ca7d8f99d: Status 404 returned error can't find the container with id c8bcbf97bf0fb37bc2b883954acccd78ed4ae5d88b33b878f2311c4ca7d8f99d
Jul 21 04:55:14.052983 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:14.052960    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 04:55:14.647465 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:14.647431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462582576" event={"ID":"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2","Type":"ContainerStarted","Data":"c8bcbf97bf0fb37bc2b883954acccd78ed4ae5d88b33b878f2311c4ca7d8f99d"}
Jul 21 04:55:15.652469 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:15.652430    2567 generic.go:356] "Generic (PLEG): container finished" podID="488c3a53-ba9e-4334-b4a1-6d40bb7bbce2" containerID="52986136e094aa24f0aa370d69467b703143b1e3c5aca70fc1a504e52c083512" exitCode=0
Jul 21 04:55:15.652878 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:15.652514    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462582576" event={"ID":"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2","Type":"ContainerDied","Data":"52986136e094aa24f0aa370d69467b703143b1e3c5aca70fc1a504e52c083512"}
Jul 21 04:55:16.787029 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.787000    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:16.823180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.823150    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7799-140183462582576_488c3a53-ba9e-4334-b4a1-6d40bb7bbce2/test-curl-7799-140183462582576/0.log"
Jul 21 04:55:16.851553 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.851523    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7799-140183462582576"]
Jul 21 04:55:16.855948 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.855919    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7799-140183462582576"]
Jul 21 04:55:16.917480 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.917379    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9zpg\" (UniqueName: \"kubernetes.io/projected/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2-kube-api-access-z9zpg\") pod \"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2\" (UID: \"488c3a53-ba9e-4334-b4a1-6d40bb7bbce2\") "
Jul 21 04:55:16.919654 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.919624    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2-kube-api-access-z9zpg" (OuterVolumeSpecName: "kube-api-access-z9zpg") pod "488c3a53-ba9e-4334-b4a1-6d40bb7bbce2" (UID: "488c3a53-ba9e-4334-b4a1-6d40bb7bbce2"). InnerVolumeSpecName "kube-api-access-z9zpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:55:16.979507 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.979466    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7799-140183462582448"]
Jul 21 04:55:16.979885 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.979866    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488c3a53-ba9e-4334-b4a1-6d40bb7bbce2" containerName="test-curl-7799-140183462582576"
Jul 21 04:55:16.979971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.979887    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="488c3a53-ba9e-4334-b4a1-6d40bb7bbce2" containerName="test-curl-7799-140183462582576"
Jul 21 04:55:16.979971 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.979967    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="488c3a53-ba9e-4334-b4a1-6d40bb7bbce2" containerName="test-curl-7799-140183462582576"
Jul 21 04:55:16.982858 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.982838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:16.990980 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:16.990954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462582448"]
Jul 21 04:55:17.018752 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.018692    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9zpg\" (UniqueName: \"kubernetes.io/projected/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2-kube-api-access-z9zpg\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:17.119151 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.119108    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/8145eae6-98df-451a-a29d-40b8e374fce9-kube-api-access-rtxfc\") pod \"test-curl-7799-140183462582448\" (UID: \"8145eae6-98df-451a-a29d-40b8e374fce9\") " pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:17.220357 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.220254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/8145eae6-98df-451a-a29d-40b8e374fce9-kube-api-access-rtxfc\") pod \"test-curl-7799-140183462582448\" (UID: \"8145eae6-98df-451a-a29d-40b8e374fce9\") " pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:17.229200 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.229158    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/8145eae6-98df-451a-a29d-40b8e374fce9-kube-api-access-rtxfc\") pod \"test-curl-7799-140183462582448\" (UID: \"8145eae6-98df-451a-a29d-40b8e374fce9\") " pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:17.292151 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.292117    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:17.357654 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.357617    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="488c3a53-ba9e-4334-b4a1-6d40bb7bbce2" path="/var/lib/kubelet/pods/488c3a53-ba9e-4334-b4a1-6d40bb7bbce2/volumes"
Jul 21 04:55:17.422288 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.422264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462582448"]
Jul 21 04:55:17.424321 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:55:17.424289    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8145eae6_98df_451a_a29d_40b8e374fce9.slice/crio-b2243773be69f0fc9515c70f01739e23ef30c4c91902b524835d88ed0f810ca6 WatchSource:0}: Error finding container b2243773be69f0fc9515c70f01739e23ef30c4c91902b524835d88ed0f810ca6: Status 404 returned error can't find the container with id b2243773be69f0fc9515c70f01739e23ef30c4c91902b524835d88ed0f810ca6
Jul 21 04:55:17.662425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.662395    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582576"
Jul 21 04:55:17.662829 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.662453    2567 scope.go:117] "RemoveContainer" containerID="52986136e094aa24f0aa370d69467b703143b1e3c5aca70fc1a504e52c083512"
Jul 21 04:55:17.663793 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:17.663612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462582448" event={"ID":"8145eae6-98df-451a-a29d-40b8e374fce9","Type":"ContainerStarted","Data":"b2243773be69f0fc9515c70f01739e23ef30c4c91902b524835d88ed0f810ca6"}
Jul 21 04:55:18.670310 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:18.670274    2567 generic.go:356] "Generic (PLEG): container finished" podID="8145eae6-98df-451a-a29d-40b8e374fce9" containerID="a806afd215da4918c9bcd9a9ccf2fed5b98f03216c4baba5c38bc2ce6f284806" exitCode=0
Jul 21 04:55:18.670310 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:18.670310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462582448" event={"ID":"8145eae6-98df-451a-a29d-40b8e374fce9","Type":"ContainerDied","Data":"a806afd215da4918c9bcd9a9ccf2fed5b98f03216c4baba5c38bc2ce6f284806"}
Jul 21 04:55:19.807381 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:19.807346    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:19.830019 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:19.829988    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7799-140183462582448_8145eae6-98df-451a-a29d-40b8e374fce9/test-curl-7799-140183462582448/0.log"
Jul 21 04:55:19.857003 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:19.856959    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7799-140183462582448"]
Jul 21 04:55:19.862869 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:19.862841    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7799-140183462582448"]
Jul 21 04:55:19.946752 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:19.946690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/8145eae6-98df-451a-a29d-40b8e374fce9-kube-api-access-rtxfc\") pod \"8145eae6-98df-451a-a29d-40b8e374fce9\" (UID: \"8145eae6-98df-451a-a29d-40b8e374fce9\") "
Jul 21 04:55:19.948855 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:19.948821    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8145eae6-98df-451a-a29d-40b8e374fce9-kube-api-access-rtxfc" (OuterVolumeSpecName: "kube-api-access-rtxfc") pod "8145eae6-98df-451a-a29d-40b8e374fce9" (UID: "8145eae6-98df-451a-a29d-40b8e374fce9"). InnerVolumeSpecName "kube-api-access-rtxfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:55:20.016882 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.016847    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:20.017181 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.017167    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8145eae6-98df-451a-a29d-40b8e374fce9" containerName="test-curl-7799-140183462582448"
Jul 21 04:55:20.017228 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.017183    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8145eae6-98df-451a-a29d-40b8e374fce9" containerName="test-curl-7799-140183462582448"
Jul 21 04:55:20.017294 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.017247    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8145eae6-98df-451a-a29d-40b8e374fce9" containerName="test-curl-7799-140183462582448"
Jul 21 04:55:20.019473 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.019458    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:20.024033 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.024008    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:20.047797 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.047690    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtxfc\" (UniqueName: \"kubernetes.io/projected/8145eae6-98df-451a-a29d-40b8e374fce9-kube-api-access-rtxfc\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:20.148911 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.148868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84brq\" (UniqueName: \"kubernetes.io/projected/4685a8bb-2616-4598-bab7-15a70646df72-kube-api-access-84brq\") pod \"test-curl-7799-140183462625760\" (UID: \"4685a8bb-2616-4598-bab7-15a70646df72\") " pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:20.249410 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.249367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84brq\" (UniqueName: \"kubernetes.io/projected/4685a8bb-2616-4598-bab7-15a70646df72-kube-api-access-84brq\") pod \"test-curl-7799-140183462625760\" (UID: \"4685a8bb-2616-4598-bab7-15a70646df72\") " pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:20.258287 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.258261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84brq\" (UniqueName: \"kubernetes.io/projected/4685a8bb-2616-4598-bab7-15a70646df72-kube-api-access-84brq\") pod \"test-curl-7799-140183462625760\" (UID: \"4685a8bb-2616-4598-bab7-15a70646df72\") " pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:20.329328 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.329239    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:20.455208 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.455184    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:20.457264 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:55:20.457240    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4685a8bb_2616_4598_bab7_15a70646df72.slice/crio-f1865e56fda3b83042c75dad2a9115b3f03798541f7d7d96d1b92bec942f8473 WatchSource:0}: Error finding container f1865e56fda3b83042c75dad2a9115b3f03798541f7d7d96d1b92bec942f8473: Status 404 returned error can't find the container with id f1865e56fda3b83042c75dad2a9115b3f03798541f7d7d96d1b92bec942f8473
Jul 21 04:55:20.679663 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.679632    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:20.679663 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.679651    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2243773be69f0fc9515c70f01739e23ef30c4c91902b524835d88ed0f810ca6"
Jul 21 04:55:20.680754 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:20.680731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462625760" event={"ID":"4685a8bb-2616-4598-bab7-15a70646df72","Type":"ContainerStarted","Data":"f1865e56fda3b83042c75dad2a9115b3f03798541f7d7d96d1b92bec942f8473"}
Jul 21 04:55:20.690404 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:55:20.690370    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7799-140183462582448\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object" podUID="8145eae6-98df-451a-a29d-40b8e374fce9" pod="opendatahub/test-curl-7799-140183462582448"
Jul 21 04:55:21.357956 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:21.357925    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8145eae6-98df-451a-a29d-40b8e374fce9" path="/var/lib/kubelet/pods/8145eae6-98df-451a-a29d-40b8e374fce9/volumes"
Jul 21 04:55:21.687163 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:21.687077    2567 generic.go:356] "Generic (PLEG): container finished" podID="4685a8bb-2616-4598-bab7-15a70646df72" containerID="69e56a0535c29723c13ee6eb35d30c72fb0aad626710933b736b26629d86664d" exitCode=0
Jul 21 04:55:21.687312 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:21.687165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462625760" event={"ID":"4685a8bb-2616-4598-bab7-15a70646df72","Type":"ContainerDied","Data":"69e56a0535c29723c13ee6eb35d30c72fb0aad626710933b736b26629d86664d"}
Jul 21 04:55:22.824649 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.824626    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:22.846692 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.846664    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7799-140183462625760_4685a8bb-2616-4598-bab7-15a70646df72/test-curl-7799-140183462625760/0.log"
Jul 21 04:55:22.870802 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.870763    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:22.874948 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.874922    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:22.972345 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.972249    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84brq\" (UniqueName: \"kubernetes.io/projected/4685a8bb-2616-4598-bab7-15a70646df72-kube-api-access-84brq\") pod \"4685a8bb-2616-4598-bab7-15a70646df72\" (UID: \"4685a8bb-2616-4598-bab7-15a70646df72\") "
Jul 21 04:55:22.974425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.974392    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4685a8bb-2616-4598-bab7-15a70646df72-kube-api-access-84brq" (OuterVolumeSpecName: "kube-api-access-84brq") pod "4685a8bb-2616-4598-bab7-15a70646df72" (UID: "4685a8bb-2616-4598-bab7-15a70646df72"). InnerVolumeSpecName "kube-api-access-84brq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:55:22.992238 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.992201    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:22.992512 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.992498    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4685a8bb-2616-4598-bab7-15a70646df72" containerName="test-curl-7799-140183462625760"
Jul 21 04:55:22.992558 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.992513    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4685a8bb-2616-4598-bab7-15a70646df72" containerName="test-curl-7799-140183462625760"
Jul 21 04:55:22.992592 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.992563    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4685a8bb-2616-4598-bab7-15a70646df72" containerName="test-curl-7799-140183462625760"
Jul 21 04:55:22.995403 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:22.995383    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:23.003067 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.003036    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:23.072944 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.072903    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84brq\" (UniqueName: \"kubernetes.io/projected/4685a8bb-2616-4598-bab7-15a70646df72-kube-api-access-84brq\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:23.173931 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.173894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfb7\" (UniqueName: \"kubernetes.io/projected/2a32fe4b-b781-44f4-9dea-fc4c75beba1b-kube-api-access-mzfb7\") pod \"test-curl-7799-140183462625760\" (UID: \"2a32fe4b-b781-44f4-9dea-fc4c75beba1b\") " pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:23.274428 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.274353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfb7\" (UniqueName: \"kubernetes.io/projected/2a32fe4b-b781-44f4-9dea-fc4c75beba1b-kube-api-access-mzfb7\") pod \"test-curl-7799-140183462625760\" (UID: \"2a32fe4b-b781-44f4-9dea-fc4c75beba1b\") " pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:23.283913 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.283877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfb7\" (UniqueName: \"kubernetes.io/projected/2a32fe4b-b781-44f4-9dea-fc4c75beba1b-kube-api-access-mzfb7\") pod \"test-curl-7799-140183462625760\" (UID: \"2a32fe4b-b781-44f4-9dea-fc4c75beba1b\") " pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:23.305923 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.305871    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:23.359848 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.359810    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4685a8bb-2616-4598-bab7-15a70646df72" path="/var/lib/kubelet/pods/4685a8bb-2616-4598-bab7-15a70646df72/volumes"
Jul 21 04:55:23.437740 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.437599    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:23.440209 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:55:23.440179    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a32fe4b_b781_44f4_9dea_fc4c75beba1b.slice/crio-f69066882554f7c96cddb295d23589246025061b78cec8050019c434e95d9f6a WatchSource:0}: Error finding container f69066882554f7c96cddb295d23589246025061b78cec8050019c434e95d9f6a: Status 404 returned error can't find the container with id f69066882554f7c96cddb295d23589246025061b78cec8050019c434e95d9f6a
Jul 21 04:55:23.697554 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.697532    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:23.697652 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.697569    2567 scope.go:117] "RemoveContainer" containerID="69e56a0535c29723c13ee6eb35d30c72fb0aad626710933b736b26629d86664d"
Jul 21 04:55:23.698683 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:23.698661    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462625760" event={"ID":"2a32fe4b-b781-44f4-9dea-fc4c75beba1b","Type":"ContainerStarted","Data":"f69066882554f7c96cddb295d23589246025061b78cec8050019c434e95d9f6a"}
Jul 21 04:55:24.705586 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:24.705550    2567 generic.go:356] "Generic (PLEG): container finished" podID="2a32fe4b-b781-44f4-9dea-fc4c75beba1b" containerID="008a375ab9ac0b034ef44afb186c867625e987398da956a67ad40d3ce54a0ea5" exitCode=0
Jul 21 04:55:24.706053 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:24.705639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462625760" event={"ID":"2a32fe4b-b781-44f4-9dea-fc4c75beba1b","Type":"ContainerDied","Data":"008a375ab9ac0b034ef44afb186c867625e987398da956a67ad40d3ce54a0ea5"}
Jul 21 04:55:25.841825 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:25.841800    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:25.862767 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:25.862744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7799-140183462625760_2a32fe4b-b781-44f4-9dea-fc4c75beba1b/test-curl-7799-140183462625760/0.log"
Jul 21 04:55:25.886477 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:25.886430    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:25.888921 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:25.888895    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7799-140183462625760"]
Jul 21 04:55:26.000805 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.000717    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzfb7\" (UniqueName: \"kubernetes.io/projected/2a32fe4b-b781-44f4-9dea-fc4c75beba1b-kube-api-access-mzfb7\") pod \"2a32fe4b-b781-44f4-9dea-fc4c75beba1b\" (UID: \"2a32fe4b-b781-44f4-9dea-fc4c75beba1b\") "
Jul 21 04:55:26.002676 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.002652    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a32fe4b-b781-44f4-9dea-fc4c75beba1b-kube-api-access-mzfb7" (OuterVolumeSpecName: "kube-api-access-mzfb7") pod "2a32fe4b-b781-44f4-9dea-fc4c75beba1b" (UID: "2a32fe4b-b781-44f4-9dea-fc4c75beba1b"). InnerVolumeSpecName "kube-api-access-mzfb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:55:26.017085 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.017052    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7799-140183462626768"]
Jul 21 04:55:26.017369 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.017356    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a32fe4b-b781-44f4-9dea-fc4c75beba1b" containerName="test-curl-7799-140183462625760"
Jul 21 04:55:26.017413 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.017371    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a32fe4b-b781-44f4-9dea-fc4c75beba1b" containerName="test-curl-7799-140183462625760"
Jul 21 04:55:26.017448 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.017434    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a32fe4b-b781-44f4-9dea-fc4c75beba1b" containerName="test-curl-7799-140183462625760"
Jul 21 04:55:26.020210 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.020194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:55:26.026608 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.026578    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462626768"]
Jul 21 04:55:26.101700 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.101663    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzfb7\" (UniqueName: \"kubernetes.io/projected/2a32fe4b-b781-44f4-9dea-fc4c75beba1b-kube-api-access-mzfb7\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:26.203043 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.203000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dnn2\" (UniqueName: \"kubernetes.io/projected/0b23da6f-8d58-42e7-87b4-ace470880b6b-kube-api-access-7dnn2\") pod \"test-curl-7799-140183462626768\" (UID: \"0b23da6f-8d58-42e7-87b4-ace470880b6b\") " pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:55:26.303995 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.303903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dnn2\" (UniqueName: \"kubernetes.io/projected/0b23da6f-8d58-42e7-87b4-ace470880b6b-kube-api-access-7dnn2\") pod \"test-curl-7799-140183462626768\" (UID: \"0b23da6f-8d58-42e7-87b4-ace470880b6b\") " pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:55:26.316206 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.316178    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dnn2\" (UniqueName: \"kubernetes.io/projected/0b23da6f-8d58-42e7-87b4-ace470880b6b-kube-api-access-7dnn2\") pod \"test-curl-7799-140183462626768\" (UID: \"0b23da6f-8d58-42e7-87b4-ace470880b6b\") " pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:55:26.330070 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.330035    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:55:26.460969 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.460942    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7799-140183462626768"]
Jul 21 04:55:26.462541 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:55:26.462518    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b23da6f_8d58_42e7_87b4_ace470880b6b.slice/crio-22e550b85d61115de7784b203dbb219202b5d83cc507ba86d4639d3b74bc18eb WatchSource:0}: Error finding container 22e550b85d61115de7784b203dbb219202b5d83cc507ba86d4639d3b74bc18eb: Status 404 returned error can't find the container with id 22e550b85d61115de7784b203dbb219202b5d83cc507ba86d4639d3b74bc18eb
Jul 21 04:55:26.716341 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.716311    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:26.716538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.716352    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f69066882554f7c96cddb295d23589246025061b78cec8050019c434e95d9f6a"
Jul 21 04:55:26.717476 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:26.717446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462626768" event={"ID":"0b23da6f-8d58-42e7-87b4-ace470880b6b","Type":"ContainerStarted","Data":"22e550b85d61115de7784b203dbb219202b5d83cc507ba86d4639d3b74bc18eb"}
Jul 21 04:55:26.727009 ip-10-0-134-95 kubenswrapper[2567]: E0721 04:55:26.726981    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7799-140183462625760\" is forbidden: User \"system:node:ip-10-0-134-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-95.ec2.internal' and this object" podUID="2a32fe4b-b781-44f4-9dea-fc4c75beba1b" pod="opendatahub/test-curl-7799-140183462625760"
Jul 21 04:55:27.358685 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.358654    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a32fe4b-b781-44f4-9dea-fc4c75beba1b" path="/var/lib/kubelet/pods/2a32fe4b-b781-44f4-9dea-fc4c75beba1b/volumes"
Jul 21 04:55:27.600098 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.600055    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz" podUID="f902ac9c-a385-4e60-9083-b415ac1c1512" containerName="main" containerID="cri-o://5790f789bd4aadc6b43e2a5661d4e7637aa4c0f6f7e89e086332e6a09fed55fd" gracePeriod=45
Jul 21 04:55:27.723485 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.723455    2567 generic.go:356] "Generic (PLEG): container finished" podID="f902ac9c-a385-4e60-9083-b415ac1c1512" containerID="5790f789bd4aadc6b43e2a5661d4e7637aa4c0f6f7e89e086332e6a09fed55fd" exitCode=0
Jul 21 04:55:27.723627 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.723521    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz" event={"ID":"f902ac9c-a385-4e60-9083-b415ac1c1512","Type":"ContainerDied","Data":"5790f789bd4aadc6b43e2a5661d4e7637aa4c0f6f7e89e086332e6a09fed55fd"}
Jul 21 04:55:27.725030 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.725010    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b23da6f-8d58-42e7-87b4-ace470880b6b" containerID="5643602d073ca723cfcce8354e887452a0fdfbc4b6c7e8b5432c04078560d0a2" exitCode=0
Jul 21 04:55:27.725153 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.725090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7799-140183462626768" event={"ID":"0b23da6f-8d58-42e7-87b4-ace470880b6b","Type":"ContainerDied","Data":"5643602d073ca723cfcce8354e887452a0fdfbc4b6c7e8b5432c04078560d0a2"}
Jul 21 04:55:27.860957 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.860932    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:55:27.918157 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918064    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-dshm\") pod \"f902ac9c-a385-4e60-9083-b415ac1c1512\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") "
Jul 21 04:55:27.918157 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-home\") pod \"f902ac9c-a385-4e60-9083-b415ac1c1512\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") "
Jul 21 04:55:27.918358 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918192    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f902ac9c-a385-4e60-9083-b415ac1c1512-tls-certs\") pod \"f902ac9c-a385-4e60-9083-b415ac1c1512\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") "
Jul 21 04:55:27.918358 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918217    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-tmp-dir\") pod \"f902ac9c-a385-4e60-9083-b415ac1c1512\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") "
Jul 21 04:55:27.918358 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918247    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-model-cache\") pod \"f902ac9c-a385-4e60-9083-b415ac1c1512\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") "
Jul 21 04:55:27.918358 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918288    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcpkv\" (UniqueName: \"kubernetes.io/projected/f902ac9c-a385-4e60-9083-b415ac1c1512-kube-api-access-pcpkv\") pod \"f902ac9c-a385-4e60-9083-b415ac1c1512\" (UID: \"f902ac9c-a385-4e60-9083-b415ac1c1512\") "
Jul 21 04:55:27.918547 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918460    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-home" (OuterVolumeSpecName: "home") pod "f902ac9c-a385-4e60-9083-b415ac1c1512" (UID: "f902ac9c-a385-4e60-9083-b415ac1c1512"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:55:27.918605 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918539    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f902ac9c-a385-4e60-9083-b415ac1c1512" (UID: "f902ac9c-a385-4e60-9083-b415ac1c1512"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:55:27.918605 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.918548    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-model-cache" (OuterVolumeSpecName: "model-cache") pod "f902ac9c-a385-4e60-9083-b415ac1c1512" (UID: "f902ac9c-a385-4e60-9083-b415ac1c1512"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:55:27.920331 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.920296    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-dshm" (OuterVolumeSpecName: "dshm") pod "f902ac9c-a385-4e60-9083-b415ac1c1512" (UID: "f902ac9c-a385-4e60-9083-b415ac1c1512"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 04:55:27.920440 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.920348    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f902ac9c-a385-4e60-9083-b415ac1c1512-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f902ac9c-a385-4e60-9083-b415ac1c1512" (UID: "f902ac9c-a385-4e60-9083-b415ac1c1512"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 04:55:27.920440 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:27.920383    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f902ac9c-a385-4e60-9083-b415ac1c1512-kube-api-access-pcpkv" (OuterVolumeSpecName: "kube-api-access-pcpkv") pod "f902ac9c-a385-4e60-9083-b415ac1c1512" (UID: "f902ac9c-a385-4e60-9083-b415ac1c1512"). InnerVolumeSpecName "kube-api-access-pcpkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:55:28.019816 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.019778    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcpkv\" (UniqueName: \"kubernetes.io/projected/f902ac9c-a385-4e60-9083-b415ac1c1512-kube-api-access-pcpkv\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:28.019816 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.019810    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-dshm\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:28.019816 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.019820    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-home\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:28.020040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.019828    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f902ac9c-a385-4e60-9083-b415ac1c1512-tls-certs\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:28.020040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.019837    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-tmp-dir\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:28.020040 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.019845    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f902ac9c-a385-4e60-9083-b415ac1c1512-model-cache\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:28.732104 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.732065    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz" event={"ID":"f902ac9c-a385-4e60-9083-b415ac1c1512","Type":"ContainerDied","Data":"5b58d46cae83af31a256881325db99469a89333f5523c3de133ab4749a3913fe"}
Jul 21 04:55:28.732536 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.732121    2567 scope.go:117] "RemoveContainer" containerID="5790f789bd4aadc6b43e2a5661d4e7637aa4c0f6f7e89e086332e6a09fed55fd"
Jul 21 04:55:28.732536 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.732085    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"
Jul 21 04:55:28.756624 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.756585    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"]
Jul 21 04:55:28.762935 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.762906    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4de716/rate-test-model-4de716-kserve-75d89bf98c-6kxnz"]
Jul 21 04:55:28.880392 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.880368    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:55:28.901918 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.901895    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7799-140183462626768_0b23da6f-8d58-42e7-87b4-ace470880b6b/test-curl-7799-140183462626768/0.log"
Jul 21 04:55:28.927538 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.927511    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7799-140183462626768"]
Jul 21 04:55:28.927806 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.927789    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dnn2\" (UniqueName: \"kubernetes.io/projected/0b23da6f-8d58-42e7-87b4-ace470880b6b-kube-api-access-7dnn2\") pod \"0b23da6f-8d58-42e7-87b4-ace470880b6b\" (UID: \"0b23da6f-8d58-42e7-87b4-ace470880b6b\") "
Jul 21 04:55:28.929745 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.929701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b23da6f-8d58-42e7-87b4-ace470880b6b-kube-api-access-7dnn2" (OuterVolumeSpecName: "kube-api-access-7dnn2") pod "0b23da6f-8d58-42e7-87b4-ace470880b6b" (UID: "0b23da6f-8d58-42e7-87b4-ace470880b6b"). InnerVolumeSpecName "kube-api-access-7dnn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 04:55:28.933851 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:28.933828    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7799-140183462626768"]
Jul 21 04:55:29.028484 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:29.028398    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dnn2\" (UniqueName: \"kubernetes.io/projected/0b23da6f-8d58-42e7-87b4-ace470880b6b-kube-api-access-7dnn2\") on node \"ip-10-0-134-95.ec2.internal\" DevicePath \"\""
Jul 21 04:55:29.358054 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:29.358017    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b23da6f-8d58-42e7-87b4-ace470880b6b" path="/var/lib/kubelet/pods/0b23da6f-8d58-42e7-87b4-ace470880b6b/volumes"
Jul 21 04:55:29.358406 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:29.358391    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f902ac9c-a385-4e60-9083-b415ac1c1512" path="/var/lib/kubelet/pods/f902ac9c-a385-4e60-9083-b415ac1c1512/volumes"
Jul 21 04:55:29.738223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:29.738137    2567 scope.go:117] "RemoveContainer" containerID="5643602d073ca723cfcce8354e887452a0fdfbc4b6c7e8b5432c04078560d0a2"
Jul 21 04:55:29.738223 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:55:29.738162    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7799-140183462626768"
Jul 21 04:56:17.043192 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:17.043158    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b7db74f5-sk2j5_10c34931-375b-4a3f-8c66-f0d3d64f0364/authorino/0.log"
Jul 21 04:56:23.087592 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:23.087558    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m6lv4_95aebd5a-9ab2-42aa-8119-fad59330af2f/server/0.log"
Jul 21 04:56:23.453497 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:23.453470    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d877cbcc8-nk5pp_31aadce4-ae55-450f-818e-a6a1058cd937/manager/0.log"
Jul 21 04:56:23.460638 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:23.460617    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d877cbcc8-nk5pp_31aadce4-ae55-450f-818e-a6a1058cd937/copy-manifests/0.log"
Jul 21 04:56:25.642744 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:25.642695    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b7db74f5-sk2j5_10c34931-375b-4a3f-8c66-f0d3d64f0364/authorino/0.log"
Jul 21 04:56:26.905049 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:26.905022    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5qk6_611af324-43e5-4226-9f0a-2749f974f842/istio-proxy/0.log"
Jul 21 04:56:27.150257 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:27.150225    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757f6cbd6c-2rvk5_42a04508-e53a-4d55-9a8d-7bb7ee811a34/kube-auth-proxy/0.log"
Jul 21 04:56:28.466051 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:28.466019    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fcltqw_bb422d30-8b95-4c9a-9b32-fe599d224fbb/main/0.log"
Jul 21 04:56:28.585926 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:28.585893    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hh8sh_7a2327f1-e2c9-4722-b562-82f2cc6ad900/main/0.log"
Jul 21 04:56:28.704322 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:28.704291    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-t28hk_2d84a26c-a02e-4935-9277-c1bacdf56d29/main/0.log"
Jul 21 04:56:37.513563 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:37.513525    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fdtdh_625bb5d4-3d41-4cef-9765-cdf270e7a9a9/global-pull-secret-syncer/0.log"
Jul 21 04:56:37.665470 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:37.665441    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-thfmv_ef114389-b1eb-4010-8898-dec6f47000c5/konnectivity-agent/0.log"
Jul 21 04:56:37.684393 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:37.684364    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-95.ec2.internal_5967dca527be5168794214a27e6630c4/haproxy/0.log"
Jul 21 04:56:42.725550 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:42.725502    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b7db74f5-sk2j5_10c34931-375b-4a3f-8c66-f0d3d64f0364/authorino/0.log"
Jul 21 04:56:45.133374 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:45.133340    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5tgf7_155aba9d-c1ca-4787-b1da-a23c33f68ab8/node-exporter/0.log"
Jul 21 04:56:45.169550 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:45.169482    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5tgf7_155aba9d-c1ca-4787-b1da-a23c33f68ab8/kube-rbac-proxy/0.log"
Jul 21 04:56:45.197293 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:45.197265    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5tgf7_155aba9d-c1ca-4787-b1da-a23c33f68ab8/init-textfile/0.log"
Jul 21 04:56:47.145374 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145335    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"]
Jul 21 04:56:47.145832 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145651    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f902ac9c-a385-4e60-9083-b415ac1c1512" containerName="main"
Jul 21 04:56:47.145832 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145662    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f902ac9c-a385-4e60-9083-b415ac1c1512" containerName="main"
Jul 21 04:56:47.145832 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145673    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b23da6f-8d58-42e7-87b4-ace470880b6b" containerName="test-curl-7799-140183462626768"
Jul 21 04:56:47.145832 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145679    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b23da6f-8d58-42e7-87b4-ace470880b6b" containerName="test-curl-7799-140183462626768"
Jul 21 04:56:47.145832 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145759    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b23da6f-8d58-42e7-87b4-ace470880b6b" containerName="test-curl-7799-140183462626768"
Jul 21 04:56:47.145832 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.145770    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f902ac9c-a385-4e60-9083-b415ac1c1512" containerName="main"
Jul 21 04:56:47.148775 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.148752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.151530 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.151507    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6wgn4\"/\"kube-root-ca.crt\""
Jul 21 04:56:47.152603 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.152583    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6wgn4\"/\"default-dockercfg-kztqk\""
Jul 21 04:56:47.152676 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.152583    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6wgn4\"/\"openshift-service-ca.crt\""
Jul 21 04:56:47.159281 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.159258    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"]
Jul 21 04:56:47.275177 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.275130    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-podres\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.275354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.275213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-proc\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.275354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.275253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-lib-modules\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.275354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.275303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6zt\" (UniqueName: \"kubernetes.io/projected/115a7163-83c3-47d0-940d-72c4b143de72-kube-api-access-sg6zt\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.275354 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.275320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-sys\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376222 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-proc\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-lib-modules\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6zt\" (UniqueName: \"kubernetes.io/projected/115a7163-83c3-47d0-940d-72c4b143de72-kube-api-access-sg6zt\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-sys\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-proc\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376425 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-podres\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376636 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376426    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-lib-modules\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376636 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376449    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-sys\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.376636 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.376494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/115a7163-83c3-47d0-940d-72c4b143de72-podres\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.392301 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.392272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6zt\" (UniqueName: \"kubernetes.io/projected/115a7163-83c3-47d0-940d-72c4b143de72-kube-api-access-sg6zt\") pod \"perf-node-gather-daemonset-4xpxn\" (UID: \"115a7163-83c3-47d0-940d-72c4b143de72\") " pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.459782 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.459650    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:47.590328 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:47.590303    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"]
Jul 21 04:56:47.592514 ip-10-0-134-95 kubenswrapper[2567]: W0721 04:56:47.592484    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod115a7163_83c3_47d0_940d_72c4b143de72.slice/crio-11dda1e3c94c6dbf5da9e64bb271b1d34d34a503e9c264c1a93d904472c158b0 WatchSource:0}: Error finding container 11dda1e3c94c6dbf5da9e64bb271b1d34d34a503e9c264c1a93d904472c158b0: Status 404 returned error can't find the container with id 11dda1e3c94c6dbf5da9e64bb271b1d34d34a503e9c264c1a93d904472c158b0
Jul 21 04:56:48.077051 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:48.076959    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn" event={"ID":"115a7163-83c3-47d0-940d-72c4b143de72","Type":"ContainerStarted","Data":"e082563bb48389e48fb56a946a4b27ac161b934bfcff960ba6aada598838a578"}
Jul 21 04:56:48.077051 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:48.077024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn" event={"ID":"115a7163-83c3-47d0-940d-72c4b143de72","Type":"ContainerStarted","Data":"11dda1e3c94c6dbf5da9e64bb271b1d34d34a503e9c264c1a93d904472c158b0"}
Jul 21 04:56:48.077244 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:48.077077    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:48.093826 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:48.093762    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn" podStartSLOduration=1.09374311 podStartE2EDuration="1.09374311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 04:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 04:56:48.092181089 +0000 UTC m=+2849.169395607" watchObservedRunningTime="2026-07-21 04:56:48.09374311 +0000 UTC m=+2849.170957600"
Jul 21 04:56:49.953901 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:49.953871    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5jsg4_3ad67e36-9907-4537-8973-ed2f3b244c96/dns/0.log"
Jul 21 04:56:49.973988 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:49.973956    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5jsg4_3ad67e36-9907-4537-8973-ed2f3b244c96/kube-rbac-proxy/0.log"
Jul 21 04:56:50.134156 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:50.134123    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mcpdj_5d6cec48-d9db-4e69-bf64-f765409ebc21/dns-node-resolver/0.log"
Jul 21 04:56:50.652956 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:50.652923    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cb5559c86-dbpfw_5c539cce-c140-4756-a9f8-6857b6eb06a1/registry/0.log"
Jul 21 04:56:50.676243 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:50.676212    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ql7lk_000e65b4-1400-44db-a04b-99509bd03df3/node-ca/0.log"
Jul 21 04:56:51.619815 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:51.619788    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5qk6_611af324-43e5-4226-9f0a-2749f974f842/istio-proxy/0.log"
Jul 21 04:56:51.793028 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:51.792991    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757f6cbd6c-2rvk5_42a04508-e53a-4d55-9a8d-7bb7ee811a34/kube-auth-proxy/0.log"
Jul 21 04:56:52.762207 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:52.762135    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cfpnb_7af66331-9ca6-4122-88c8-1ffafc788501/serve-healthcheck-canary/0.log"
Jul 21 04:56:53.439399 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:53.439365    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wsqst_4a4c0547-8eca-4817-9772-37e331110632/kube-rbac-proxy/0.log"
Jul 21 04:56:53.459866 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:53.459841    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wsqst_4a4c0547-8eca-4817-9772-37e331110632/exporter/0.log"
Jul 21 04:56:53.479937 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:53.479910    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wsqst_4a4c0547-8eca-4817-9772-37e331110632/extractor/0.log"
Jul 21 04:56:54.091062 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:54.091034    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6wgn4/perf-node-gather-daemonset-4xpxn"
Jul 21 04:56:55.932180 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:55.932155    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m6lv4_95aebd5a-9ab2-42aa-8119-fad59330af2f/server/0.log"
Jul 21 04:56:56.146655 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:56.146626    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d877cbcc8-nk5pp_31aadce4-ae55-450f-818e-a6a1058cd937/manager/0.log"
Jul 21 04:56:56.170019 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:56.169992    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d877cbcc8-nk5pp_31aadce4-ae55-450f-818e-a6a1058cd937/copy-manifests/0.log"
Jul 21 04:56:57.477702 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:57.477663    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5qk6_611af324-43e5-4226-9f0a-2749f974f842/istio-proxy/0.log"
Jul 21 04:56:57.608675 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:57.608648    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757f6cbd6c-2rvk5_42a04508-e53a-4d55-9a8d-7bb7ee811a34/kube-auth-proxy/0.log"
Jul 21 04:56:57.640250 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:57.640221    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b844b6c94-fl94z_525bb684-0731-458a-b18c-e304621cd1f5/manager/0.log"
Jul 21 04:56:58.984323 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:58.984239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5qk6_611af324-43e5-4226-9f0a-2749f974f842/istio-proxy/0.log"
Jul 21 04:56:59.119306 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:56:59.119281    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-757f6cbd6c-2rvk5_42a04508-e53a-4d55-9a8d-7bb7ee811a34/kube-auth-proxy/0.log"
Jul 21 04:57:02.479842 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:02.479789    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fdv2v_0232f700-8b80-43d2-965c-18013d0d85fe/migrator/0.log"
Jul 21 04:57:02.503565 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:02.503536    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-fdv2v_0232f700-8b80-43d2-965c-18013d0d85fe/graceful-termination/0.log"
Jul 21 04:57:04.053439 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.053411    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/kube-multus-additional-cni-plugins/0.log"
Jul 21 04:57:04.079162 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.079133    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/egress-router-binary-copy/0.log"
Jul 21 04:57:04.100034 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.100008    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/cni-plugins/0.log"
Jul 21 04:57:04.120369 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.120340    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/bond-cni-plugin/0.log"
Jul 21 04:57:04.141968 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.141937    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/routeoverride-cni/0.log"
Jul 21 04:57:04.162936 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.162905    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/whereabouts-cni-bincopy/0.log"
Jul 21 04:57:04.184207 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.184177    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jwjwb_2fdb106c-497a-46de-8104-1aa9efa70f55/whereabouts-cni/0.log"
Jul 21 04:57:04.405536 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.405502    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nlwjc_08415d15-e118-4247-b7a7-fba68b82fba8/kube-multus/0.log"
Jul 21 04:57:04.523510 ip-10-0-134-95 kubenswrapper[2567]: I0721 04:57:04.523478    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ckbdx_8dd1956a-3358-4238-afb8-7dae2afa9f72/network-metrics-daemon/0.log"