Jul 08 19:58:13.996748 ip-10-0-136-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 19:58:13.996757 ip-10-0-136-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 19:58:13.996764 ip-10-0-136-70 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 19:58:13.996989 ip-10-0-136-70 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 19:58:24.002919 ip-10-0-136-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 19:58:24.002934 ip-10-0-136-70 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 84d327b4caa745f6bbf00ec8556ed0a9 --
Jul 08 19:59:52.379131 ip-10-0-136-70 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.823671    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828854    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828873    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828880    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828886    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828890    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828893    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:59:52.956914 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828897    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:59:52.909229 ip-10-0-136-70 systemd[1]: Started Kubernetes Kubelet.
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828900    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828902    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828905    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828908    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828912    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828916    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828919    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828922    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828925    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828927    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828930    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828933    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828936    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828938    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828941    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828943    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828946    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828949    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:59:52.961275 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828951    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828961    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828964    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828967    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828970    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828973    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828976    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828978    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828982    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828985    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828987    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828990    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828992    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828995    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.828997    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829000    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829002    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829005    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829007    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829009    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:59:52.963189 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829012    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829015    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829018    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829020    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829023    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829026    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829029    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829032    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829034    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829037    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829040    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829048    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829050    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829053    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829056    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829059    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829062    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829064    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829067    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829070    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:59:52.964610 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829072    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829075    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829077    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829080    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829083    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829085    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829088    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829090    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829093    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829095    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829098    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829100    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829103    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829106    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829108    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829111    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829113    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829116    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829120    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829123    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:59:52.965294 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829125    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829128    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829131    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829133    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829136    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829139    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829141    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829144    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829147    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829149    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829151    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829154    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829157    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829159    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829898    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829905    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829908    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829911    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829914    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829916    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:59:52.966476 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829919    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829922    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829924    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829927    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829930    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829932    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829935    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829938    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829941    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829943    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829946    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829950    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829953    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829955    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829958    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829960    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829963    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829965    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829968    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829971    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:59:52.967525 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829973    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829976    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829979    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829981    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829984    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829986    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829989    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829992    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829995    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.829997    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830000    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830003    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830005    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830008    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830011    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830014    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830017    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830021    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830025    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:59:52.968445 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830029    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830032    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830035    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830039    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830042    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830045    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830048    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830051    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830056    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830059    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830063    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830065    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830068    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830071    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830074    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830076    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830079    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830082    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830084    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:59:52.970556 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830087    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830089    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830092    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830094    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830097    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830099    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830102    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830104    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830107    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830109    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830112    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830115    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830119    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830122    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830124    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830127    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830129    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830132    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830139    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830142    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:59:52.984137 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830145    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830148    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830150    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830153    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830156    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830159    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830161    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830164    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830166    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830169    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830171    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830174    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830176    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830179    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830181    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830581    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830586    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830588    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830591    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830594    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:59:53.010790 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830596    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830599    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830601    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830604    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830607    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830610    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830613    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830615    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830618    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830620    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830625    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830628    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830630    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830633    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830636    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830638    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830640    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830643    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830646    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:59:53.011682 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830648    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830651    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830653    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830655    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830661    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830663    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830665    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830668    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830671    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830673    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830676    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830679    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830681    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830684    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830687    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830690    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830692    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830695    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830697    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830700    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:59:53.012404 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830702    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830705    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830709    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830714    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830717    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830720    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830724    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830728    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830731    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830734    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830737    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830740    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830742    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830745    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830747    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830750    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830754    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830757    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830759    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:59:53.013073 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830762    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830764    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830766    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830769    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830772    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830774    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830777    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830779    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830782    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830784    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830788    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830791    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830795    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830797    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830800    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830802    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830806    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830809    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830811    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830830    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:59:53.013619 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830833    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830836    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830839    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830841    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830844    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830847    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830849    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830852    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830854    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830858    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830861    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830863    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830866    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830868    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830871    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.830873    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.830958    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.830969    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.830979    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.830985    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.830991    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 19:59:53.014351 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.830996    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831002    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831006    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831009    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831012    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831016    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831019    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831023    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831026    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831029    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831032    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831036    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831039    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831043    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831046    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831049    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831052    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831055    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831059    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831062    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831066    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831069    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831073    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831076    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 19:59:53.014971 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831079    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831082    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831085    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831089    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831092    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831095    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831098    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831101    2582 flags.go:64] FLAG: --enable-server="true"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831104    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831107    2582 flags.go:64] FLAG: --event-burst="100"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831110    2582 flags.go:64] FLAG: --event-qps="50"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831113    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831116    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831119    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831123    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831127    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831130    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831133    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831136    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831139    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831142    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831145    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831148    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831151    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831153    2582 flags.go:64] FLAG: --feature-gates=""
Jul 08 19:59:53.015887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831157    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831160    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831163    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831167    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831170    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831173    2582 flags.go:64] FLAG: --help="false"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831176    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831179    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831182    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831185    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831188    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831192    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831195    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831197    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831200    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831202    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831205    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831208    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831211    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831214    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831217    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831220    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831224    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831226    2582 flags.go:64] FLAG: --lock-file=""
Jul 08 19:59:53.016601 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831229    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831232    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831235    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831245    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831249    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831252    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831255    2582 flags.go:64] FLAG: --logging-format="text"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831258    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831262    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831265    2582 flags.go:64] FLAG: --manifest-url=""
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831268    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831273    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831277    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831281    2582 flags.go:64] FLAG: --max-pods="110"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831284    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831287    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831290    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831293    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831295    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831298    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831301    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831313    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831316    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831319    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 19:59:53.017426 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831322    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831324    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831330    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831332    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831335    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831338    2582 flags.go:64] FLAG: --port="10250"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831342    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831346    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cfb37295bb9cfd70"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831349    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831352    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831355    2582 flags.go:64] FLAG: --register-node="true"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831358    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831362    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831365    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831368    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831371    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831375    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831378    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831381    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831385    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831388    2582 flags.go:64] FLAG: --runonce="false"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831391    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831394    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831397    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831399    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 19:59:53.018110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831402    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831405    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831408    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831411    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831414    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831416    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831419    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831422    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831425    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831428    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831431    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831436    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831438    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831441    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831446    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831448    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831451    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831454    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831457    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831460    2582 flags.go:64] FLAG: --v="2"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831464    2582 flags.go:64] FLAG: --version="false"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831468    2582 flags.go:64] FLAG: --vmodule=""
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831472    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.831475    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831598    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:59:53.152950 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831602    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831607    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831610    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831613    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831616    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831619    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831621    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831624    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831627    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831629    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831632    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831634    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831637    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831640    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831642    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831644    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831647    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831650    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831653    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831655    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:59:53.154486 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831658    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831662    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831664    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831667    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831669    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831672    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831675    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831677    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831680    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831683    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831686    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831688    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831690    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831695    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831697    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831700    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831703    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831705    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831707    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831710    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:59:53.158784 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831712    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831715    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831717    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831720    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831722    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831725    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831727    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831730    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831732    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831735    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831737    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831740    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831742    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831746    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831749    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831752    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831756    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831759    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831762    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831765    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:59:53.159555 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831768    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831771    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831774    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831776    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831779    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831783    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831785    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831788    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831790    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831793    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831795    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831798    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831801    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831803    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831806    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831808    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831811    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831813    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831832    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831834    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:59:53.162667 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831837    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831840    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831843    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831847    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831850    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831854    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831857    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831860    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831862    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831865    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831868    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831871    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831873    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831876    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831878    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831881    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831884    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:59:53.163418 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.831888    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.832647    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.840058    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.840075    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.840095    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.840101    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840172    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840178    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840182    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840186    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840189    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840192    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840195    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840198    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840201    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:59:53.166166 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840204    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840208    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840212    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840215    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840218    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840221    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840223    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840226    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840229    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840231    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840234    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840236    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840239    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840242    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840244    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840248    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840250    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840253    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840256    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840259    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:59:53.166953 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840262    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840264    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840267    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840269    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840272    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840275    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840278    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840281    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840283    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840286    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840289    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840291    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840294    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840296    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840299    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840301    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840304    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840306    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840309    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:59:53.171699 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840312    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840314    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840317    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840319    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840322    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840325    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840329    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840331    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840334    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840337    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840341    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840345    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840348    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840351    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840354    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840357    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840360    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840363    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840365    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840368    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:59:53.172479 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840371    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840374    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840377    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840379    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840382    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840384    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840386    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840389    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840392    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840394    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840397    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840400    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840402    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840405    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840407    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840410    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840412    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840415    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840418    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840421    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:59:53.176341 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840424    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840427    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840430    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840433    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840435    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840438    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840440    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840443    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840446    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840448    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840451    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.840456    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840583    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840587    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 19:59:53.177119 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840590    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840593    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840595    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840598    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840602    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840605    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840608    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840610    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840613    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840617    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840620    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840623    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840626    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840629    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840634    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840637    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840640    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840642    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840645    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 19:59:53.179866 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840651    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840654    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840658    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840661    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840664    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840666    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840669    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840671    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840674    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840676    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840679    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840681    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840684    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840687    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840689    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840693    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840696    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840699    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840701    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840704    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 19:59:53.180649 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840707    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840709    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840712    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840714    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840716    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840719    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840721    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840725    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840728    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840730    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840733    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840736    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840739    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840742    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840745    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840747    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840750    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840753    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840755    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840758    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 19:59:53.183361 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840761    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840763    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840766    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840768    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840771    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840773    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840776    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840779    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840781    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840784    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840787    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840789    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840792    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840794    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840797    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840799    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840802    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840804    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840807    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840810    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 19:59:53.184135 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840813    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840835    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840839    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840843    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840847    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840850    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840852    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840855    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840858    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840861    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840864    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840866    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840869    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840871    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840874    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840876    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840879    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 19:59:53.281242 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:52.840881    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.840887    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.841008    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.843475    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.845161    2582 server.go:1019] "Starting client certificate rotation"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.845276    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.846204    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.848117    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.851848    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.867856    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.871146    2582 log.go:25] "Validated CRI v1 image API"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.872404    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 19:59:53.281984 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.877654    2582 fs.go:135] Filesystem UUIDs: map[3e2a1b34-bb7b-4111-8cd6-94da38219df0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9464fd52-3164-4ca9-a258-53d3839eb05a:/dev/nvme0n1p4]
Jul 08 19:59:53.286672 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.877671    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 19:59:53.286672 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.878970    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.882854    2582 manager.go:216] Machine: {Timestamp:2026-07-08 19:59:52.881428033 +0000 UTC m=+0.371932606 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123368 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28d51b73091a5f57cb0f65585aa10e SystemUUID:ec28d51b-7309-1a5f-57cb-0f65585aa10e BootID:84d327b4-caa7-45f6-bbf0-0ec8556ed0a9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:c6:f8:36:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:c6:f8:36:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:eb:bd:51:d3:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.882958    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.883039    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.886532    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.886560    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.887398    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.887409    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.887416    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.889190    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.891140    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895712    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895869    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895897    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895907    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895923    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895932    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.895942    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 19:59:53.287843 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.896315    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.896336    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.899599    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.902072    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.902100    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903432    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903447    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903452    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903457    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903466    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903471    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903480    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903485    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903492    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903498    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903506    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.903511    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.904424    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.904431    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.907852    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.907954    2582 server.go:1268] "Started kubelet"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.908168    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.908267    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.908325    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.908834    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.908834    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.909741    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.910603    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.914259    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.915651    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-70.ec2.internal.18c068e6cbb20ea9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-70.ec2.internal,UID:ip-10-0-136-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-70.ec2.internal,},FirstTimestamp:2026-07-08 19:59:52.907927209 +0000 UTC m=+0.398431781,LastTimestamp:2026-07-08 19:59:52.907927209 +0000 UTC m=+0.398431781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-70.ec2.internal,}"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.919697    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.919717    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.920908    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921168    2582 factory.go:55] Registering systemd factory
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921185    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921660    2582 factory.go:153] Registering CRI-O factory
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921675    2582 factory.go:223] Registration of the crio container factory successfully
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921798    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921853    2582 factory.go:103] Registering Raw factory
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.921871    2582 manager.go:1196] Started watching for new ooms in manager
Jul 08 19:59:53.292129 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.922410    2582 manager.go:349] Starting recovery of all containers
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.922857    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.924132    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.924281    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.924444    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.924452    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.924713    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.926005    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.934606    2582 manager.go:354] Recovery completed
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.936339    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jkbzj"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.940116    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942256    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942283    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942293    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942880    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942888    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942898    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.942912    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.943619    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.943652    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.943666    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.944634    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-70.ec2.internal.18c068e6cdbe1090  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-70.ec2.internal,UID:ip-10-0-136-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-70.ec2.internal,},FirstTimestamp:2026-07-08 19:59:52.94226856 +0000 UTC m=+0.432773132,LastTimestamp:2026-07-08 19:59:52.94226856 +0000 UTC m=+0.432773132,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-70.ec2.internal,}"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.945091    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jkbzj"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.945147    2582 policy_none.go:49] "None policy: Start"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.945163    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.945173    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.948971    2582 policy_none.go:47] "Start"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.996718    2582 manager.go:337] "Starting Device Plugin manager"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.996947    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.996961    2582 server.go:87] "Starting device plugin registration server"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.997233    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.997245    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.997345    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.997423    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:52.997433    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.998014    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:52.998063    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.029826    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.030967    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.030999    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.031020    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 19:59:53.293271 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:53.031049    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.035308    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.098269    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.099640    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.099666    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.099678    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.099704    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.111915    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:53.111938    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-70.ec2.internal\": node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.132008    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"]
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.132068    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.133015    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.133053    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.133064    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.135601    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.135835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.135860    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.136433    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.136452    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.136471    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.136521    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.136558    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.136576    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:53.138270    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.138986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.139019    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.139773    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.139798    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.139809    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeHasSufficientPID"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.226351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88112ed6c612604914d2dd7bceddbed3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal\" (UID: \"88112ed6c612604914d2dd7bceddbed3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.226386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88112ed6c612604914d2dd7bceddbed3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal\" (UID: \"88112ed6c612604914d2dd7bceddbed3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.226405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/746e513d115f3461d223f76aeed02dcc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-70.ec2.internal\" (UID: \"746e513d115f3461d223f76aeed02dcc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.294445 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:53.238578    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.327404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88112ed6c612604914d2dd7bceddbed3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal\" (UID: \"88112ed6c612604914d2dd7bceddbed3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.327459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/746e513d115f3461d223f76aeed02dcc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-70.ec2.internal\" (UID: \"746e513d115f3461d223f76aeed02dcc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.327489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88112ed6c612604914d2dd7bceddbed3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal\" (UID: \"88112ed6c612604914d2dd7bceddbed3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.327497    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88112ed6c612604914d2dd7bceddbed3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal\" (UID: \"88112ed6c612604914d2dd7bceddbed3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.327554    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88112ed6c612604914d2dd7bceddbed3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal\" (UID: \"88112ed6c612604914d2dd7bceddbed3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:53.327554    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/746e513d115f3461d223f76aeed02dcc-config\") pod \"kube-apiserver-proxy-ip-10-0-136-70.ec2.internal\" (UID: \"746e513d115f3461d223f76aeed02dcc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:53.398176 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:53.339442    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:54.779276 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:54.719925    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:54.820651 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:54.820573    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:54.835607 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:54.835577    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-70.ec2.internal\" not found" node="ip-10-0-136-70.ec2.internal"
Jul 08 19:59:54.837644 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:54.837627    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:54.839966 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:54.839947    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-70.ec2.internal\" not found" node="ip-10-0-136-70.ec2.internal"
Jul 08 19:59:54.842468 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:54.842269    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:54.920967 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:54.920930    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:55.021661 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:55.021630    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:55.122339 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:55.122240    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:55.124384 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.124358    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 19:59:55.124517 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.124499    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 19:59:55.222608 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:55.222572    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-70.ec2.internal\" not found"
Jul 08 19:59:55.230758 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.230726    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 19:54:54 +0000 UTC" deadline="2028-02-02 02:06:26.602608437 +0000 UTC"
Jul 08 19:59:55.230758 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.230754    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13758h6m31.371857475s"
Jul 08 19:59:55.297252 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.297221    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:59:55.300707 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.300688    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:55.314967 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.314945    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 19:59:55.316431 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.316418    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal"
Jul 08 19:59:55.324752 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.324735    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 19:59:55.627399 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:55.627357    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746e513d115f3461d223f76aeed02dcc.slice/crio-e06a696dbd630c77da952fe497d1b062f814faa5769ad2c8556e86a2d9d6e5a0 WatchSource:0}: Error finding container e06a696dbd630c77da952fe497d1b062f814faa5769ad2c8556e86a2d9d6e5a0: Status 404 returned error can't find the container with id e06a696dbd630c77da952fe497d1b062f814faa5769ad2c8556e86a2d9d6e5a0
Jul 08 19:59:55.627665 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:55.627649    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88112ed6c612604914d2dd7bceddbed3.slice/crio-efc0574b6ea027722bc0861d0eb37a099f7abc75347b9cfe1bd562d83b77d49f WatchSource:0}: Error finding container efc0574b6ea027722bc0861d0eb37a099f7abc75347b9cfe1bd562d83b77d49f: Status 404 returned error can't find the container with id efc0574b6ea027722bc0861d0eb37a099f7abc75347b9cfe1bd562d83b77d49f
Jul 08 19:59:55.633792 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.633773    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 19:59:55.742110 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.742081    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:59:55.799599 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.799526    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:59:55.951217 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:55.951179    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 19:59:56.176407 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.176311    2582 apiserver.go:52] "Watching apiserver"
Jul 08 19:59:56.183739 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.183718    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 19:59:56.184088 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.184068    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-52gqd","openshift-image-registry/node-ca-95ggm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal","openshift-multus/multus-additional-cni-plugins-rtwdx","openshift-multus/network-metrics-daemon-jmwmx","openshift-network-diagnostics/network-check-target-9lnq9","kube-system/konnectivity-agent-v4x7k","kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal","openshift-dns/node-resolver-vxzk5","openshift-multus/multus-26kxm","openshift-network-operator/iptables-alerter-9px5c","openshift-ovn-kubernetes/ovnkube-node-s8nf6","kube-system/global-pull-secret-syncer-7xrb4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"]
Jul 08 19:59:56.187875 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.187858    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.189945 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.189911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.190060 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.190001    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 19:59:56.192025 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.192005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.193542 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.193524    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 19:59:56.193617 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.193596    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 19:59:56.193666 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.193643    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f68r2\""
Jul 08 19:59:56.194349 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.194184    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.196622 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.195968    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 19:59:56.196622 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.196251    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.196622 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.196421    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.196622 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.196560    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-plmqf\""
Jul 08 19:59:56.197849 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.197442    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.197849 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.197521    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 19:59:56.197849 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.197564    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 19:59:56.197849 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.197632    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 19:59:56.197849 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.197655    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dgm57\""
Jul 08 19:59:56.198280 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.198256    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.198573 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.198557    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.198652 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.198622    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 19:59:56.199675 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.199659    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 19:59:56.200626 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.200609    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:56.200744 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.200674    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 19:59:56.202745 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.202728    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.205471 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.205445    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d4rbf\""
Jul 08 19:59:56.205569 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.205473    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.205569 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.205501    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.205569 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.205554    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.207833 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.207816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.208652 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.208634    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ft2ll\""
Jul 08 19:59:56.208652 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.208647    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.208955 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.208937    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.210057 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.210043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.210147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.210132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.210582 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.210568    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 19:59:56.210920 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.210901    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.211013 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.210938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n6x45\""
Jul 08 19:59:56.212390 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.212376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.212935 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.212917    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 19:59:56.213024 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.212942    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sf64l\""
Jul 08 19:59:56.213086 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.213038    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 19:59:56.214787 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.214771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.215059 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:56.215144 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-os-release\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215144 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215144 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-tmp-dir\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.215305 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-dbus\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.215305 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-device-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.215305 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-system-cni-dir\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215305 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-kubelet-config\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.215305 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-sys-fs\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.215305 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-registration-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqtr\" (UniqueName: \"kubernetes.io/projected/0ad61b40-1bcf-4561-9149-c266f076cedb-kube-api-access-dzqtr\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d26a251-cab9-46e9-8b30-9f9077ce8180-agent-certs\") pod \"konnectivity-agent-v4x7k\" (UID: \"3d26a251-cab9-46e9-8b30-9f9077ce8180\") " pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-hosts-file\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6sl\" (UniqueName: \"kubernetes.io/projected/7727a3af-2ec8-404c-8b42-72d979865c67-kube-api-access-nm6sl\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215570 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzgvs\" (UniqueName: \"kubernetes.io/projected/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-kube-api-access-vzgvs\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.215921 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215921 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kxdz\" (UniqueName: \"kubernetes.io/projected/feb7733f-2a25-481b-8c31-9477c1e451cc-kube-api-access-7kxdz\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.215921 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d26a251-cab9-46e9-8b30-9f9077ce8180-konnectivity-ca\") pod \"konnectivity-agent-v4x7k\" (UID: \"3d26a251-cab9-46e9-8b30-9f9077ce8180\") " pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.215921 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-cnibin\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215921 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.215921 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.215682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-socket-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.216965 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.216947    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.217065 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.217050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.217294 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.217279    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 19:59:56.217462 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.217448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6dwkq\""
Jul 08 19:59:56.219409 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.219395    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 19:59:56.222304 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.222241    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 19:59:56.222304 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.222274    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 19:59:56.222450 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.222394    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 19:59:56.222450 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.222438    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 19:59:56.222717 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.222699    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2hl6h\""
Jul 08 19:59:56.222866 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.222854    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 19:59:56.254897 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.254875    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpn27"
Jul 08 19:59:56.261679 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.261661    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cpn27"
Jul 08 19:59:56.303772 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.303747    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 19:59:56.315059 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.315015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal" event={"ID":"746e513d115f3461d223f76aeed02dcc","Type":"ContainerStarted","Data":"e06a696dbd630c77da952fe497d1b062f814faa5769ad2c8556e86a2d9d6e5a0"}
Jul 08 19:59:56.315906 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.315867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.316002 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.315917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysctl-d\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.316002 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.315913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal" event={"ID":"88112ed6c612604914d2dd7bceddbed3","Type":"ContainerStarted","Data":"efc0574b6ea027722bc0861d0eb37a099f7abc75347b9cfe1bd562d83b77d49f"}
Jul 08 19:59:56.316002 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.315941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-cni-bin\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.316002 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.315982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ea61b38-4211-4323-8d39-ac12580a41f3-iptables-alerter-script\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.316147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-etc-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-node-log\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316069    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfdfd\" (UniqueName: \"kubernetes.io/projected/910c5708-6231-443a-8cc0-32f5cb580349-kube-api-access-vfdfd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-socket-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.316147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-os-release\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.316147 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-cni-bin\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-env-overrides\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316236    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-os-release\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-socket-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-tmp-dir\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-cnibin\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316300    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-slash\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316348    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-ovnkube-config\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-kubelet-config\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-sys-fs\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-var-lib-kubelet\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-sys-fs\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316437    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-kubelet-config\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.316438 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-tuned\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-system-cni-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-var-lib-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-ovn\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-tmp-dir\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316560    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqtr\" (UniqueName: \"kubernetes.io/projected/0ad61b40-1bcf-4561-9149-c266f076cedb-kube-api-access-dzqtr\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-hostroot\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316755    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-cni-netd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d26a251-cab9-46e9-8b30-9f9077ce8180-agent-certs\") pod \"konnectivity-agent-v4x7k\" (UID: \"3d26a251-cab9-46e9-8b30-9f9077ce8180\") " pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-hosts-file\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6sl\" (UniqueName: \"kubernetes.io/projected/7727a3af-2ec8-404c-8b42-72d979865c67-kube-api-access-nm6sl\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.317109 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316973    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-hosts-file\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.316975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-host\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-serviceca\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.317034    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317067    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-etc-selinux\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.317115    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 19:59:56.817085391 +0000 UTC m=+3.028092011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqfwl\" (UniqueName: \"kubernetes.io/projected/386f2be3-d4b7-4036-9571-4ae75d74a937-kube-api-access-cqfwl\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzgvs\" (UniqueName: \"kubernetes.io/projected/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-kube-api-access-vzgvs\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317185    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kxdz\" (UniqueName: \"kubernetes.io/projected/feb7733f-2a25-481b-8c31-9477c1e451cc-kube-api-access-7kxdz\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-lib-modules\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-kubelet\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-systemd\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-os-release\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-k8s-cni-cncf-io\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ea61b38-4211-4323-8d39-ac12580a41f3-host-slash\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-run-netns\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.317848 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317379    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-cnibin\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-kubernetes\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-cnibin\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/215b3b29-b711-4f95-bd5a-0148f2e4b083-tmp\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-ovnkube-script-lib\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-host\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k5pf\" (UniqueName: \"kubernetes.io/projected/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-kube-api-access-8k5pf\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/386f2be3-d4b7-4036-9571-4ae75d74a937-cni-binary-copy\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-kubelet\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-log-socket\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/910c5708-6231-443a-8cc0-32f5cb580349-ovn-node-metrics-cert\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-dbus\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-device-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-system-cni-dir\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-sys\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317795    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-device-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.318678 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66dps\" (UniqueName: \"kubernetes.io/projected/215b3b29-b711-4f95-bd5a-0148f2e4b083-kube-api-access-66dps\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317827    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7727a3af-2ec8-404c-8b42-72d979865c67-system-cni-dir\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-multus-certs\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317864    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-dbus\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-etc-kubernetes\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fvdh\" (UniqueName: \"kubernetes.io/projected/0ea61b38-4211-4323-8d39-ac12580a41f3-kube-api-access-5fvdh\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-registration-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.317989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-cni-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-daemon-config\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-systemd-units\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318069    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.318087    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysconfig\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318115    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ad61b40-1bcf-4561-9149-c266f076cedb-registration-dir\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.319169 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.318131    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 19:59:56.818118048 +0000 UTC m=+3.029124653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysctl-conf\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-socket-dir-parent\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-cni-multus\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-conf-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-systemd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-run\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-netns\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d26a251-cab9-46e9-8b30-9f9077ce8180-konnectivity-ca\") pod \"konnectivity-agent-v4x7k\" (UID: \"3d26a251-cab9-46e9-8b30-9f9077ce8180\") " pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-modprobe-d\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318531    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318674    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7727a3af-2ec8-404c-8b42-72d979865c67-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.319629 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.318734    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3d26a251-cab9-46e9-8b30-9f9077ce8180-konnectivity-ca\") pod \"konnectivity-agent-v4x7k\" (UID: \"3d26a251-cab9-46e9-8b30-9f9077ce8180\") " pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.320479 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.320464    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3d26a251-cab9-46e9-8b30-9f9077ce8180-agent-certs\") pod \"konnectivity-agent-v4x7k\" (UID: \"3d26a251-cab9-46e9-8b30-9f9077ce8180\") " pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.327628 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.327599    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kxdz\" (UniqueName: \"kubernetes.io/projected/feb7733f-2a25-481b-8c31-9477c1e451cc-kube-api-access-7kxdz\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.327723 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.327674    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqtr\" (UniqueName: \"kubernetes.io/projected/0ad61b40-1bcf-4561-9149-c266f076cedb-kube-api-access-dzqtr\") pod \"aws-ebs-csi-driver-node-rhw42\" (UID: \"0ad61b40-1bcf-4561-9149-c266f076cedb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.327977 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.327960    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6sl\" (UniqueName: \"kubernetes.io/projected/7727a3af-2ec8-404c-8b42-72d979865c67-kube-api-access-nm6sl\") pod \"multus-additional-cni-plugins-rtwdx\" (UID: \"7727a3af-2ec8-404c-8b42-72d979865c67\") " pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.328045 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.328030    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzgvs\" (UniqueName: \"kubernetes.io/projected/2dcbe74c-c83b-4c8c-8f27-301b2a346c64-kube-api-access-vzgvs\") pod \"node-resolver-vxzk5\" (UID: \"2dcbe74c-c83b-4c8c-8f27-301b2a346c64\") " pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.329119 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.329105    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:59:56.329185 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.329123    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:59:56.329185 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.329133    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:56.329251 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.329186    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 19:59:56.8291728 +0000 UTC m=+3.040179405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-system-cni-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-var-lib-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-ovn\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-hostroot\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-cni-netd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.418992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-host\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-serviceca\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqfwl\" (UniqueName: \"kubernetes.io/projected/386f2be3-d4b7-4036-9571-4ae75d74a937-kube-api-access-cqfwl\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-lib-modules\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-kubelet\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-systemd\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-os-release\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-k8s-cni-cncf-io\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ea61b38-4211-4323-8d39-ac12580a41f3-host-slash\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-run-netns\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-kubernetes\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/215b3b29-b711-4f95-bd5a-0148f2e4b083-tmp\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-ovnkube-script-lib\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-host\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k5pf\" (UniqueName: \"kubernetes.io/projected/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-kube-api-access-8k5pf\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/386f2be3-d4b7-4036-9571-4ae75d74a937-cni-binary-copy\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-kubelet\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-log-socket\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/910c5708-6231-443a-8cc0-32f5cb580349-ovn-node-metrics-cert\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419510    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-system-cni-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-sys\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419571    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-sys\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66dps\" (UniqueName: \"kubernetes.io/projected/215b3b29-b711-4f95-bd5a-0148f2e4b083-kube-api-access-66dps\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-multus-certs\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.419854 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-etc-kubernetes\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fvdh\" (UniqueName: \"kubernetes.io/projected/0ea61b38-4211-4323-8d39-ac12580a41f3-kube-api-access-5fvdh\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-cni-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-daemon-config\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419749    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-serviceca\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-systemd-units\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysconfig\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419845    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-cni-netd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysctl-conf\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-socket-dir-parent\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419900    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-ovn\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-cni-multus\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-socket-dir-parent\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-conf-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419981    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysctl-conf\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-systemd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-host\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.420748 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-var-lib-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420032    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-systemd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420060    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-conf-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420072    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420097    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-cni-multus\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420140    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ea61b38-4211-4323-8d39-ac12580a41f3-host-slash\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420236    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-kubelet\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420269    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-lib-modules\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420284    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-log-socket\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.419453    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-hostroot\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420337    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-kubelet\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420379    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-etc-kubernetes\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-systemd\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420414    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-multus-certs\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420459    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-os-release\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420504    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-k8s-cni-cncf-io\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420632    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/386f2be3-d4b7-4036-9571-4ae75d74a937-cni-binary-copy\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420653    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-cni-dir\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.423292 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-run-netns\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-systemd-units\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.420928    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-host\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421143    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/386f2be3-d4b7-4036-9571-4ae75d74a937-multus-daemon-config\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421202    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-kubernetes\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421249    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-run-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421303    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysconfig\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-run\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-netns\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-modprobe-d\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421485    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-run\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421494    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-ovnkube-script-lib\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-modprobe-d\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysctl-d\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421546    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-run-netns\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-cni-bin\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ea61b38-4211-4323-8d39-ac12580a41f3-iptables-alerter-script\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-etc-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.424196 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-node-log\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421641    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-host-var-lib-cni-bin\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfdfd\" (UniqueName: \"kubernetes.io/projected/910c5708-6231-443a-8cc0-32f5cb580349-kube-api-access-vfdfd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-cni-bin\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-env-overrides\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421738    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-sysctl-d\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421761    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-cnibin\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-slash\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421791    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-cni-bin\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421792    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-etc-openvswitch\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-ovnkube-config\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421834    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-node-log\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-var-lib-kubelet\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.421866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-tuned\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.422298    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ea61b38-4211-4323-8d39-ac12580a41f3-iptables-alerter-script\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.422374    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-run-ovn-kubernetes\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.422505    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/910c5708-6231-443a-8cc0-32f5cb580349-host-slash\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.425056 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.422889    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-env-overrides\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.427145 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.422954    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/386f2be3-d4b7-4036-9571-4ae75d74a937-cnibin\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.427145 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.422964    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/910c5708-6231-443a-8cc0-32f5cb580349-ovnkube-config\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.427145 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.423001    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/215b3b29-b711-4f95-bd5a-0148f2e4b083-var-lib-kubelet\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.428655 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.428610    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/215b3b29-b711-4f95-bd5a-0148f2e4b083-tmp\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.429247 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.429226    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/910c5708-6231-443a-8cc0-32f5cb580349-ovn-node-metrics-cert\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.429807 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.429768    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/215b3b29-b711-4f95-bd5a-0148f2e4b083-etc-tuned\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.432112 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.432062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k5pf\" (UniqueName: \"kubernetes.io/projected/ecb31af8-ee41-4f4b-9b7d-819c4606e4f9-kube-api-access-8k5pf\") pod \"node-ca-95ggm\" (UID: \"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9\") " pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.433210 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.433153    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66dps\" (UniqueName: \"kubernetes.io/projected/215b3b29-b711-4f95-bd5a-0148f2e4b083-kube-api-access-66dps\") pod \"tuned-52gqd\" (UID: \"215b3b29-b711-4f95-bd5a-0148f2e4b083\") " pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.434812 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.434791    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqfwl\" (UniqueName: \"kubernetes.io/projected/386f2be3-d4b7-4036-9571-4ae75d74a937-kube-api-access-cqfwl\") pod \"multus-26kxm\" (UID: \"386f2be3-d4b7-4036-9571-4ae75d74a937\") " pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.435498 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.435476    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fvdh\" (UniqueName: \"kubernetes.io/projected/0ea61b38-4211-4323-8d39-ac12580a41f3-kube-api-access-5fvdh\") pod \"iptables-alerter-9px5c\" (UID: \"0ea61b38-4211-4323-8d39-ac12580a41f3\") " pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.435657 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.435633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfdfd\" (UniqueName: \"kubernetes.io/projected/910c5708-6231-443a-8cc0-32f5cb580349-kube-api-access-vfdfd\") pod \"ovnkube-node-s8nf6\" (UID: \"910c5708-6231-443a-8cc0-32f5cb580349\") " pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.499701 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.499671    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 19:59:56.504929 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.504424    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42"
Jul 08 19:59:56.512300 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.512113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtwdx"
Jul 08 19:59:56.514947 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.514917    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d26a251_cab9_46e9_8b30_9f9077ce8180.slice/crio-c56c222e2dc85b11a599135d5dfe8f24e9b1ac6dc9e6be78f4c7cb12ce6600c6 WatchSource:0}: Error finding container c56c222e2dc85b11a599135d5dfe8f24e9b1ac6dc9e6be78f4c7cb12ce6600c6: Status 404 returned error can't find the container with id c56c222e2dc85b11a599135d5dfe8f24e9b1ac6dc9e6be78f4c7cb12ce6600c6
Jul 08 19:59:56.517079 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.516928    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vxzk5"
Jul 08 19:59:56.517079 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.517033    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad61b40_1bcf_4561_9149_c266f076cedb.slice/crio-ee3d5b9aa07297f86c5dffe2acbef8698795a5c2ceeb28b5ebb94ac037ee5706 WatchSource:0}: Error finding container ee3d5b9aa07297f86c5dffe2acbef8698795a5c2ceeb28b5ebb94ac037ee5706: Status 404 returned error can't find the container with id ee3d5b9aa07297f86c5dffe2acbef8698795a5c2ceeb28b5ebb94ac037ee5706
Jul 08 19:59:56.521597 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.521577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52gqd"
Jul 08 19:59:56.523345 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.523293    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7727a3af_2ec8_404c_8b42_72d979865c67.slice/crio-8340e82ad16517484f0268f352fb38b3f840ebade709e2ec5a5339adcb97a327 WatchSource:0}: Error finding container 8340e82ad16517484f0268f352fb38b3f840ebade709e2ec5a5339adcb97a327: Status 404 returned error can't find the container with id 8340e82ad16517484f0268f352fb38b3f840ebade709e2ec5a5339adcb97a327
Jul 08 19:59:56.527642 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.527620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95ggm"
Jul 08 19:59:56.529990 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.529964    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dcbe74c_c83b_4c8c_8f27_301b2a346c64.slice/crio-f3662d44c79c7da6a751ddfcbe40201455243d11c2656c8ab4895cb6b19c4f70 WatchSource:0}: Error finding container f3662d44c79c7da6a751ddfcbe40201455243d11c2656c8ab4895cb6b19c4f70: Status 404 returned error can't find the container with id f3662d44c79c7da6a751ddfcbe40201455243d11c2656c8ab4895cb6b19c4f70
Jul 08 19:59:56.532828 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.532808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-26kxm"
Jul 08 19:59:56.534168 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.534070    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215b3b29_b711_4f95_bd5a_0148f2e4b083.slice/crio-ff0dc3b045d7039505044f24a0fa36a71a1909326295da438856ec57d9e09a2b WatchSource:0}: Error finding container ff0dc3b045d7039505044f24a0fa36a71a1909326295da438856ec57d9e09a2b: Status 404 returned error can't find the container with id ff0dc3b045d7039505044f24a0fa36a71a1909326295da438856ec57d9e09a2b
Jul 08 19:59:56.540308 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.540123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9px5c"
Jul 08 19:59:56.541390 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.541351    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb31af8_ee41_4f4b_9b7d_819c4606e4f9.slice/crio-1fc4c2cff6f22d7448835cb33e210c361a844d0b17c0e0927ff3c615daff92d9 WatchSource:0}: Error finding container 1fc4c2cff6f22d7448835cb33e210c361a844d0b17c0e0927ff3c615daff92d9: Status 404 returned error can't find the container with id 1fc4c2cff6f22d7448835cb33e210c361a844d0b17c0e0927ff3c615daff92d9
Jul 08 19:59:56.545542 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.545260    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 19:59:56.562080 ip-10-0-136-70 kubenswrapper[2582]: W0708 19:59:56.562054    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910c5708_6231_443a_8cc0_32f5cb580349.slice/crio-387eaae26b9d05b848c103a41bf73d7e3e4cc24ce3a92159c3af27180ec5fc32 WatchSource:0}: Error finding container 387eaae26b9d05b848c103a41bf73d7e3e4cc24ce3a92159c3af27180ec5fc32: Status 404 returned error can't find the container with id 387eaae26b9d05b848c103a41bf73d7e3e4cc24ce3a92159c3af27180ec5fc32
Jul 08 19:59:56.825454 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.825364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:56.825454 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.825442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:56.825672 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.825619    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:56.825718 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.825681    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 19:59:57.825654276 +0000 UTC m=+4.036660880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:56.825718 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.825616    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:56.825800 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.825773    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 19:59:57.825753842 +0000 UTC m=+4.036760448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:56.926782 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:56.926738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:56.927001 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.926977    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:59:56.927001 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.927007    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:59:56.927186 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.927024    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:56.927186 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:56.927099    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 19:59:57.927071257 +0000 UTC m=+4.138077881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:57.265443 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.265333    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:54:56 +0000 UTC" deadline="2028-04-19 07:47:37.826152916 +0000 UTC"
Jul 08 19:59:57.265443 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.265392    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15611h47m40.560765639s"
Jul 08 19:59:57.320009 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.319970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"387eaae26b9d05b848c103a41bf73d7e3e4cc24ce3a92159c3af27180ec5fc32"}
Jul 08 19:59:57.321779 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.321745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-26kxm" event={"ID":"386f2be3-d4b7-4036-9571-4ae75d74a937","Type":"ContainerStarted","Data":"b3791e5a27c637ca58a60a865fa25c7c8f981134bfe14a67fae09011c4f76c9b"}
Jul 08 19:59:57.323080 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.323034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95ggm" event={"ID":"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9","Type":"ContainerStarted","Data":"1fc4c2cff6f22d7448835cb33e210c361a844d0b17c0e0927ff3c615daff92d9"}
Jul 08 19:59:57.325017 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.324990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52gqd" event={"ID":"215b3b29-b711-4f95-bd5a-0148f2e4b083","Type":"ContainerStarted","Data":"ff0dc3b045d7039505044f24a0fa36a71a1909326295da438856ec57d9e09a2b"}
Jul 08 19:59:57.326162 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.326139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vxzk5" event={"ID":"2dcbe74c-c83b-4c8c-8f27-301b2a346c64","Type":"ContainerStarted","Data":"f3662d44c79c7da6a751ddfcbe40201455243d11c2656c8ab4895cb6b19c4f70"}
Jul 08 19:59:57.327414 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.327380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerStarted","Data":"8340e82ad16517484f0268f352fb38b3f840ebade709e2ec5a5339adcb97a327"}
Jul 08 19:59:57.328880 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.328846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9px5c" event={"ID":"0ea61b38-4211-4323-8d39-ac12580a41f3","Type":"ContainerStarted","Data":"7a30a4cd9f30a651d822ebfb58d9edb44ae4021d1dfaed8024e0cd2523c23b39"}
Jul 08 19:59:57.330233 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.330209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42" event={"ID":"0ad61b40-1bcf-4561-9149-c266f076cedb","Type":"ContainerStarted","Data":"ee3d5b9aa07297f86c5dffe2acbef8698795a5c2ceeb28b5ebb94ac037ee5706"}
Jul 08 19:59:57.331382 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.331358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v4x7k" event={"ID":"3d26a251-cab9-46e9-8b30-9f9077ce8180","Type":"ContainerStarted","Data":"c56c222e2dc85b11a599135d5dfe8f24e9b1ac6dc9e6be78f4c7cb12ce6600c6"}
Jul 08 19:59:57.834887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.834569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:57.834887 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.834655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:57.834887 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.834746    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:57.834887 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.834802    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:57.834887 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.834823    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 19:59:59.834804347 +0000 UTC m=+6.045810968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:57.834887 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.834857    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 19:59:59.834839045 +0000 UTC m=+6.045845652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:57.936065 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:57.936026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:57.936239 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.936199    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:59:57.936239 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.936218    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:59:57.936239 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.936233    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:57.936415 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:57.936290    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 19:59:59.936272084 +0000 UTC m=+6.147278691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:58.266594 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:58.265700    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:54:56 +0000 UTC" deadline="2028-03-17 21:23:05.849131154 +0000 UTC"
Jul 08 19:59:58.266594 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:58.265959    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14833h23m7.583178703s"
Jul 08 19:59:58.312370 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:58.311446    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:58.312370 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:58.311591    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 19:59:58.312370 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:58.312001    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:58.312370 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:58.312094    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 19:59:58.312370 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:58.312198    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:58.312370 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:58.312273    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 19:59:59.346309 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:59.346228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal" event={"ID":"746e513d115f3461d223f76aeed02dcc","Type":"ContainerStarted","Data":"7eccc906851e4a59451dcc24dd2077edd611e3624dca802ef1f1f03aefd8824e"}
Jul 08 19:59:59.351989 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:59.351522    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal" event={"ID":"88112ed6c612604914d2dd7bceddbed3","Type":"ContainerStarted","Data":"8cad57e9de5604f5a61bbe0ed01114aa6ed55413ba6309ecadd087995d51445a"}
Jul 08 19:59:59.382281 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:59.381447    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-70.ec2.internal" podStartSLOduration=4.381426089 podStartE2EDuration="4.381426089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:59:59.362515055 +0000 UTC m=+5.573521683" watchObservedRunningTime="2026-07-08 19:59:59.381426089 +0000 UTC m=+5.592432716"
Jul 08 19:59:59.852182 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:59.852091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 19:59:59.852182 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:59.852180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 19:59:59.852433 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.852331    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:59.852433 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.852394    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 20:00:03.852376628 +0000 UTC m=+10.063383234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 19:59:59.852818 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.852799    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:59.852912 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.852855    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:03.852840275 +0000 UTC m=+10.063846882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 19:59:59.952663 ip-10-0-136-70 kubenswrapper[2582]: I0708 19:59:59.952618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 19:59:59.952851 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.952790    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 19:59:59.952851 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.952809    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 19:59:59.952851 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.952823    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 19:59:59.953014 ip-10-0-136-70 kubenswrapper[2582]: E0708 19:59:59.952881    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:03.952864147 +0000 UTC m=+10.163870753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:00.311528 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:00.311449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:00.311689 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:00.311459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:00.311689 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:00.311598    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:00.311689 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:00.311625    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:00.311848 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:00.311804    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:00.311905 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:00.311886    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:02.311350 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:02.311301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:02.311822 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:02.311459    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:02.311882 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:02.311862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:02.311999 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:02.311973    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:02.312132 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:02.312115    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:02.312217 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:02.312198    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:03.363219 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:03.362487    2582 generic.go:356] "Generic (PLEG): container finished" podID="88112ed6c612604914d2dd7bceddbed3" containerID="8cad57e9de5604f5a61bbe0ed01114aa6ed55413ba6309ecadd087995d51445a" exitCode=0
Jul 08 20:00:03.363219 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:03.362544    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal" event={"ID":"88112ed6c612604914d2dd7bceddbed3","Type":"ContainerDied","Data":"8cad57e9de5604f5a61bbe0ed01114aa6ed55413ba6309ecadd087995d51445a"}
Jul 08 20:00:03.885386 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:03.885342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:03.885568 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:03.885431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:03.885633 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.885586    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 20:00:03.885692 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.885651    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:11.885632736 +0000 UTC m=+18.096639346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 20:00:03.885908 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.885874    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 20:00:03.885996 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.885962    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 20:00:11.885942843 +0000 UTC m=+18.096949470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 20:00:03.986282 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:03.986238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:03.986476 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.986461    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 20:00:03.986553 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.986482    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 20:00:03.986553 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.986497    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:03.986648 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:03.986557    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:11.986539192 +0000 UTC m=+18.197545799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:04.313165 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:04.312512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:04.313165 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:04.312627    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:04.313165 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:04.312694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:04.313165 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:04.312774    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:04.313934 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:04.313899    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:04.314045 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:04.314022    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:06.311454 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:06.311417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:06.311910 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:06.311551    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:06.311969 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:06.311917    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:06.312056 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:06.312019    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:06.312198 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:06.312181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:06.312331 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:06.312296    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:08.311122 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:08.311087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:08.311617 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:08.311128    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:08.311617 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:08.311087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:08.311617 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:08.311222    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:08.311617 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:08.311274    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:08.311617 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:08.311370    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:10.311021 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:10.310986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:10.311456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:10.310986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:10.311456 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:10.311115    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:10.311456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:10.310986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:10.311456 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:10.311165    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:10.311456 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:10.311282    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:11.943794 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:11.943707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:11.943794 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:11.943788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:11.944342 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:11.943831    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 20:00:11.944342 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:11.943860    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 20:00:11.944342 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:11.943899    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:27.943881756 +0000 UTC m=+34.154888366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 20:00:11.944342 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:11.943912    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 20:00:27.943906072 +0000 UTC m=+34.154912680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 20:00:12.044532 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:12.044502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:12.044701 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.044627    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 20:00:12.044701 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.044642    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 20:00:12.044701 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.044650    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:12.044815 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.044704    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:28.044688395 +0000 UTC m=+34.255695018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:12.311063 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:12.310986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:12.311215 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:12.310986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:12.311215 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:12.310986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:12.311215 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.311118    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:12.311215 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.311182    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:12.311434 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:12.311265    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:14.314360 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:14.314307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:14.314797 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:14.314439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:14.314797 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:14.314448    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:14.314797 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:14.314470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:14.314797 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:14.314554    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:14.314797 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:14.314632    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:16.313942 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.313727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:16.314630 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.313777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:16.314630 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:16.314012    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:16.314630 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:16.314091    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:16.314630 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.313802    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:16.314630 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:16.314191    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:16.390087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.389939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-26kxm" event={"ID":"386f2be3-d4b7-4036-9571-4ae75d74a937","Type":"ContainerStarted","Data":"232d8781321f9f03ca7ad12557bd428c4a035bacc85e7da6f4a615011b68883c"}
Jul 08 20:00:16.391291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.391266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95ggm" event={"ID":"ecb31af8-ee41-4f4b-9b7d-819c4606e4f9","Type":"ContainerStarted","Data":"8bf4ae04a739e996543ca894d04ee1278c2c7ac11b8e93c0d55593819bee965c"}
Jul 08 20:00:16.392656 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.392637    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52gqd" event={"ID":"215b3b29-b711-4f95-bd5a-0148f2e4b083","Type":"ContainerStarted","Data":"248f6a0db5b5ef3b64940d6a87119e594f05f5815f966d1a31466a7c15176356"}
Jul 08 20:00:16.394041 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.394022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vxzk5" event={"ID":"2dcbe74c-c83b-4c8c-8f27-301b2a346c64","Type":"ContainerStarted","Data":"17dca3b46ac0b9f53f161b8dc9d27b7af5939a4f2d95ab63df5bbcf770a3c279"}
Jul 08 20:00:16.395416 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.395395    2582 generic.go:356] "Generic (PLEG): container finished" podID="7727a3af-2ec8-404c-8b42-72d979865c67" containerID="fbf5c59e6bb16cb33bbb464b614bd8fc7c3ba2e50489bc59d06ad4f26c445d0d" exitCode=0
Jul 08 20:00:16.395517 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.395458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerDied","Data":"fbf5c59e6bb16cb33bbb464b614bd8fc7c3ba2e50489bc59d06ad4f26c445d0d"}
Jul 08 20:00:16.397006 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.396982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42" event={"ID":"0ad61b40-1bcf-4561-9149-c266f076cedb","Type":"ContainerStarted","Data":"e7bc2c05a1b6680f947264d64d15e0c1bafd592af6571af4c8c2ae78bca7bdc2"}
Jul 08 20:00:16.398484 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.398459    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v4x7k" event={"ID":"3d26a251-cab9-46e9-8b30-9f9077ce8180","Type":"ContainerStarted","Data":"9506d0d58eceb8e506637658e90a85370ee6dc73f10a5ef089020989a4353c44"}
Jul 08 20:00:16.399995 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.399976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal" event={"ID":"88112ed6c612604914d2dd7bceddbed3","Type":"ContainerStarted","Data":"2e87144020a4e24c2e0daec370233c44ce7ea02e4836968665bc36947f6f4510"}
Jul 08 20:00:16.401386 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.401368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"131e6657ffb14653b64749cba1ce597ae8892e84f0c2e5676145ee017ffbc501"}
Jul 08 20:00:16.401500 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.401425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"254851c3ae5866c7c63af38b40a876f38fb3bd71520e200e86e97897a438ee26"}
Jul 08 20:00:16.412548 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.412502    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-26kxm" podStartSLOduration=3.111949457 podStartE2EDuration="22.412485289s" totalImagesPullingTime="19.300535832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:16.411802004 +0000 UTC m=+22.622808629" watchObservedRunningTime="2026-07-08 20:00:16.412485289 +0000 UTC m=+22.623491916"
Jul 08 20:00:16.450003 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.449959    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-70.ec2.internal" podStartSLOduration=21.449943239 podStartE2EDuration="21.449943239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:16.428218684 +0000 UTC m=+22.639225311" watchObservedRunningTime="2026-07-08 20:00:16.449943239 +0000 UTC m=+22.660949864"
Jul 08 20:00:16.464625 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.464584    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vxzk5" podStartSLOduration=3.363519881 podStartE2EDuration="22.464569959s" totalImagesPullingTime="19.101050078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:16.46440334 +0000 UTC m=+22.675409966" watchObservedRunningTime="2026-07-08 20:00:16.464569959 +0000 UTC m=+22.675576584"
Jul 08 20:00:16.483284 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.483245    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-52gqd" podStartSLOduration=3.211881046 podStartE2EDuration="22.483230707s" totalImagesPullingTime="19.271349661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:16.483080863 +0000 UTC m=+22.694087488" watchObservedRunningTime="2026-07-08 20:00:16.483230707 +0000 UTC m=+22.694237333"
Jul 08 20:00:16.500645 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.500607    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-95ggm" podStartSLOduration=7.398841502 podStartE2EDuration="22.500591199s" totalImagesPullingTime="15.101749697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:16.500245917 +0000 UTC m=+22.711252543" watchObservedRunningTime="2026-07-08 20:00:16.500591199 +0000 UTC m=+22.711597822"
Jul 08 20:00:16.528296 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:16.528255    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v4x7k" podStartSLOduration=7.397592263 podStartE2EDuration="22.528239765s" totalImagesPullingTime="15.130647502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:16.528001431 +0000 UTC m=+22.739008057" watchObservedRunningTime="2026-07-08 20:00:16.528239765 +0000 UTC m=+22.739246390"
Jul 08 20:00:17.406434 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.406344    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"fe22d58de8c65b841c0701d118f50e34a9e0b1d3255b273387ebcc8af21a0de0"}
Jul 08 20:00:17.406944 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.406460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"88e70aa550caa86c3ed443f2aa4da2cdcf6ddf3e65b9f7c7a8f8ed15b2cf8521"}
Jul 08 20:00:17.406944 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.406510    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"549ef593427073ee6d0e10d89ddc0dfd2cf15b8e17340f57f29201a4d4abfe4e"}
Jul 08 20:00:17.406944 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.406540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"af5027f9df1f07b610f42cc6e27b2855c51f7a956833bfec42f0ef435ee34711"}
Jul 08 20:00:17.407683 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.407644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9px5c" event={"ID":"0ea61b38-4211-4323-8d39-ac12580a41f3","Type":"ContainerStarted","Data":"a08d49ec7845270cb1810e5a16736f6edebd73b0f69b183af6f171b0971b1d74"}
Jul 08 20:00:17.425638 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.425586    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9px5c" podStartSLOduration=4.356517513 podStartE2EDuration="23.42556909s" totalImagesPullingTime="19.069051577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:17.425553278 +0000 UTC m=+23.636559904" watchObservedRunningTime="2026-07-08 20:00:17.42556909 +0000 UTC m=+23.636575715"
Jul 08 20:00:17.741734 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:17.741705    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 20:00:18.292358 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.292245    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T20:00:17.741725641Z","UUID":"62717542-5988-4cf1-9675-1f11d8d38983","Handler":null,"Name":"","Endpoint":""}
Jul 08 20:00:18.293690 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.293670    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 20:00:18.293809 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.293704    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 20:00:18.313736 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.313705    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:18.313891 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.313796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:18.313891 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:18.313802    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:18.313891 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.313821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:18.313997 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:18.313900    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:18.313997 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:18.313971    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:18.410816 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:18.410776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42" event={"ID":"0ad61b40-1bcf-4561-9149-c266f076cedb","Type":"ContainerStarted","Data":"062818d251e1fb1dc142e64fb200a180f24f9f67f6297f790438aa2bb0cdb8ef"}
Jul 08 20:00:19.417566 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:19.417395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"8c3c8a003a6ccae165676a61ab02725a06894c631f8215d3192d7a5c0c214bf4"}
Jul 08 20:00:20.314961 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.314926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:20.315130 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:20.315048    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:20.315262 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.315220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:20.315262 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.315230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:20.315420 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:20.315356    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:20.315487 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:20.315466    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:20.421696 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.421665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42" event={"ID":"0ad61b40-1bcf-4561-9149-c266f076cedb","Type":"ContainerStarted","Data":"a092814bdc3fde0b5691eb4241621e8d4272ef38c3d109f76b491c978b367fcb"}
Jul 08 20:00:20.448356 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.448286    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rhw42" podStartSLOduration=3.985317905 podStartE2EDuration="26.448270267s" totalImagesPullingTime="22.462952362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:20.447627561 +0000 UTC m=+26.658634197" watchObservedRunningTime="2026-07-08 20:00:20.448270267 +0000 UTC m=+26.659276892"
Jul 08 20:00:20.979331 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.979290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 20:00:20.979965 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:20.979935    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 20:00:21.424663 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:21.424628    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 20:00:21.425620 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:21.425595    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v4x7k"
Jul 08 20:00:22.311655 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.311506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:22.311749 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.311516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:22.311749 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:22.311736    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:22.311856 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:22.311836    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:22.311894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.311546    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:22.311949 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:22.311932    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:22.430651 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.430622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerStarted","Data":"bc2bbd971b73f35ba1e36154151b70bba6eda6bed378d769d5b2feb0bc40077b"}
Jul 08 20:00:22.434032 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.434006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" event={"ID":"910c5708-6231-443a-8cc0-32f5cb580349","Type":"ContainerStarted","Data":"512c063d215725a4ee01f2cb1ac73f9ed358419ae407b8910bae024eb803b0fb"}
Jul 08 20:00:22.434267 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.434249    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 20:00:22.434365 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.434352    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 20:00:22.434416 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.434400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 20:00:22.453130 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.453098    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 20:00:22.468739 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.468715    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 20:00:22.490727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:22.490634    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6" podStartSLOduration=8.931877915 podStartE2EDuration="28.490618433s" totalImagesPullingTime="19.558740518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:22.490469168 +0000 UTC m=+28.701475793" watchObservedRunningTime="2026-07-08 20:00:22.490618433 +0000 UTC m=+28.701625222"
Jul 08 20:00:23.438067 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.438033    2582 generic.go:356] "Generic (PLEG): container finished" podID="7727a3af-2ec8-404c-8b42-72d979865c67" containerID="bc2bbd971b73f35ba1e36154151b70bba6eda6bed378d769d5b2feb0bc40077b" exitCode=0
Jul 08 20:00:23.438628 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.438116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerDied","Data":"bc2bbd971b73f35ba1e36154151b70bba6eda6bed378d769d5b2feb0bc40077b"}
Jul 08 20:00:23.983030 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.982993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9lnq9"]
Jul 08 20:00:23.983220 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.983133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:23.983294 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:23.983235    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:23.986777 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.986741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jmwmx"]
Jul 08 20:00:23.986894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.986864    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:23.986983 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:23.986965    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:23.987310 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.987290    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7xrb4"]
Jul 08 20:00:23.987411 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:23.987398    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:23.987497 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:23.987477    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:25.311037 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:25.311015    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:25.311394 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:25.311116    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:25.311394 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:25.311170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:25.311394 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:25.311242    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:25.445212 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:25.444954    2582 generic.go:356] "Generic (PLEG): container finished" podID="7727a3af-2ec8-404c-8b42-72d979865c67" containerID="7d3e8fb0076bf853065344faf2a0d5dcc150a124334678585b0cf966290b96f0" exitCode=0
Jul 08 20:00:25.445212 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:25.445040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerDied","Data":"7d3e8fb0076bf853065344faf2a0d5dcc150a124334678585b0cf966290b96f0"}
Jul 08 20:00:26.311140 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:26.311101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:26.311653 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:26.311266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:27.311606 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:27.311578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:27.312122 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:27.311585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:27.312122 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:27.311680    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:27.312122 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:27.311755    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:27.451294 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:27.451258    2582 generic.go:356] "Generic (PLEG): container finished" podID="7727a3af-2ec8-404c-8b42-72d979865c67" containerID="f096dee49da25c725cd01acf775762e0f45d7c25f7efe02126dd1857cdff680c" exitCode=0
Jul 08 20:00:27.451468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:27.451311    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerDied","Data":"f096dee49da25c725cd01acf775762e0f45d7c25f7efe02126dd1857cdff680c"}
Jul 08 20:00:27.967037 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:27.967004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:27.967037 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:27.967052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:27.967309 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:27.967168    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 20:00:27.967309 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:27.967214    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 20:00:27.967309 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:27.967246    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 20:00:59.96722583 +0000 UTC m=+66.178232439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 20:00:27.967309 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:27.967264    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret podName:d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:59.967252279 +0000 UTC m=+66.178258887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret") pod "global-pull-secret-syncer-7xrb4" (UID: "d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54") : object "kube-system"/"original-pull-secret" not registered
Jul 08 20:00:28.068069 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:28.068031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:28.068208 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:28.068182    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 20:00:28.068208 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:28.068201    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 20:00:28.068294 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:28.068211    2582 projected.go:196] Error preparing data for projected volume kube-api-access-5p8qc for pod openshift-network-diagnostics/network-check-target-9lnq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:28.068294 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:28.068261    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc podName:83379520-a9e5-4389-b1a4-90178b34a150 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:00.068245449 +0000 UTC m=+66.279252054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p8qc" (UniqueName: "kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc") pod "network-check-target-9lnq9" (UID: "83379520-a9e5-4389-b1a4-90178b34a150") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 20:00:28.311468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:28.311440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:28.311624 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:28.311579    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmwmx" podUID="feb7733f-2a25-481b-8c31-9477c1e451cc"
Jul 08 20:00:29.311517 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.311479    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:29.311686 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.311615    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9lnq9" podUID="83379520-a9e5-4389-b1a4-90178b34a150"
Jul 08 20:00:29.311686 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.311665    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:29.312049 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.311782    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xrb4" podUID="d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54"
Jul 08 20:00:29.573453 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.573363    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-70.ec2.internal" event="NodeReady"
Jul 08 20:00:29.573614 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.573526    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 20:00:29.609883 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.609848    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78d9c465fd-vzs6l"]
Jul 08 20:00:29.613618 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.613596    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.618443 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.618403    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 20:00:29.618579 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.618453    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 20:00:29.618780 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.618762    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62jd7\""
Jul 08 20:00:29.618883 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.618799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 20:00:29.627503 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.627271    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 20:00:29.627953 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.627933    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2x9jp"]
Jul 08 20:00:29.631822 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.631802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d9c465fd-vzs6l"]
Jul 08 20:00:29.631913 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.631841    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m2rhg"]
Jul 08 20:00:29.631965 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.631943    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.635572 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.635393    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 20:00:29.635572 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.635470    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 20:00:29.635752 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.635731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.636241 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.636221    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-psksh\""
Jul 08 20:00:29.638225 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.638206    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 20:00:29.639899 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.639864    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 20:00:29.639984 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.639916    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 20:00:29.640037 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.639999    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6mhjs\""
Jul 08 20:00:29.642571 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.642552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2x9jp"]
Jul 08 20:00:29.646024 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.646007    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2rhg"]
Jul 08 20:00:29.779370 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-installation-pull-secrets\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdlvt\" (UniqueName: \"kubernetes.io/projected/69078ca8-87fd-444c-9383-8ba19d928474-kube-api-access-cdlvt\") pod \"ingress-canary-m2rhg\" (UID: \"69078ca8-87fd-444c-9383-8ba19d928474\") " pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.779561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779503    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-bound-sa-token\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-trusted-ca\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/656f74cf-0962-49ad-84b0-7b49bddaf406-tmp-dir\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.779727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/656f74cf-0962-49ad-84b0-7b49bddaf406-config-volume\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.779727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-registry-certificates\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0af205fc-e910-4446-8bf0-a82aac21b662-ca-trust-extracted\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjzcj\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-kube-api-access-jjzcj\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779900 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779742    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69078ca8-87fd-444c-9383-8ba19d928474-cert\") pod \"ingress-canary-m2rhg\" (UID: \"69078ca8-87fd-444c-9383-8ba19d928474\") " pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.779900 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-image-registry-private-configuration\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.779900 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5576k\" (UniqueName: \"kubernetes.io/projected/656f74cf-0962-49ad-84b0-7b49bddaf406-kube-api-access-5576k\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.779900 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.779853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.880856 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69078ca8-87fd-444c-9383-8ba19d928474-cert\") pod \"ingress-canary-m2rhg\" (UID: \"69078ca8-87fd-444c-9383-8ba19d928474\") " pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.880856 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-image-registry-private-configuration\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.880856 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5576k\" (UniqueName: \"kubernetes.io/projected/656f74cf-0962-49ad-84b0-7b49bddaf406-kube-api-access-5576k\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-installation-pull-secrets\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdlvt\" (UniqueName: \"kubernetes.io/projected/69078ca8-87fd-444c-9383-8ba19d928474-kube-api-access-cdlvt\") pod \"ingress-canary-m2rhg\" (UID: \"69078ca8-87fd-444c-9383-8ba19d928474\") " pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.880983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-bound-sa-token\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-trusted-ca\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.881067    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:00:29.881109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/656f74cf-0962-49ad-84b0-7b49bddaf406-tmp-dir\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.881137    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:30.381116825 +0000 UTC m=+36.592123436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/656f74cf-0962-49ad-84b0-7b49bddaf406-config-volume\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.881190    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.881205    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-registry-certificates\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0af205fc-e910-4446-8bf0-a82aac21b662-ca-trust-extracted\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:29.881257    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:30.381242235 +0000 UTC m=+36.592248852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjzcj\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-kube-api-access-jjzcj\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.881476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881433    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/656f74cf-0962-49ad-84b0-7b49bddaf406-tmp-dir\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.881887 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.881616    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0af205fc-e910-4446-8bf0-a82aac21b662-ca-trust-extracted\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.882344 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.882277    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/656f74cf-0962-49ad-84b0-7b49bddaf406-config-volume\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.883011 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.882966    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-registry-certificates\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.883234 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.883211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-trusted-ca\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.885885 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.885863    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-installation-pull-secrets\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.886060 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.885863    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-image-registry-private-configuration\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.886060 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.885866    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69078ca8-87fd-444c-9383-8ba19d928474-cert\") pod \"ingress-canary-m2rhg\" (UID: \"69078ca8-87fd-444c-9383-8ba19d928474\") " pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.891437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.891412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-bound-sa-token\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.891561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.891524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5576k\" (UniqueName: \"kubernetes.io/projected/656f74cf-0962-49ad-84b0-7b49bddaf406-kube-api-access-5576k\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:29.891683 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.891660    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdlvt\" (UniqueName: \"kubernetes.io/projected/69078ca8-87fd-444c-9383-8ba19d928474-kube-api-access-cdlvt\") pod \"ingress-canary-m2rhg\" (UID: \"69078ca8-87fd-444c-9383-8ba19d928474\") " pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:29.892935 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.892913    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjzcj\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-kube-api-access-jjzcj\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:29.950456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:29.950411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m2rhg"
Jul 08 20:00:30.104946 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.104725    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m2rhg"]
Jul 08 20:00:30.109274 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:00:30.109242    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69078ca8_87fd_444c_9383_8ba19d928474.slice/crio-0ab75d9a1a1898cf934ede62d90fa997e8175c4372eac3ea23aa12bb67fef03e WatchSource:0}: Error finding container 0ab75d9a1a1898cf934ede62d90fa997e8175c4372eac3ea23aa12bb67fef03e: Status 404 returned error can't find the container with id 0ab75d9a1a1898cf934ede62d90fa997e8175c4372eac3ea23aa12bb67fef03e
Jul 08 20:00:30.311518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.311487    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:00:30.314437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.314413    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 20:00:30.314437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.314430    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zs499\""
Jul 08 20:00:30.385486 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.385450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:30.385654 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.385505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:30.385654 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:30.385605    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:00:30.385731 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:30.385670    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:31.385655206 +0000 UTC m=+37.596661809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:00:30.385731 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:30.385608    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:00:30.385731 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:30.385691    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:00:30.385731 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:30.385712    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:31.385705633 +0000 UTC m=+37.596712262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:00:30.443750 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.443722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:30.460292 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.460261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2rhg" event={"ID":"69078ca8-87fd-444c-9383-8ba19d928474","Type":"ContainerStarted","Data":"0ab75d9a1a1898cf934ede62d90fa997e8175c4372eac3ea23aa12bb67fef03e"}
Jul 08 20:00:30.541888 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:30.541860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:31.311446 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.311214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:00:31.311446 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.311259    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:00:31.315894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.315855    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 20:00:31.316236 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.316113    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 20:00:31.316342 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.316328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sqvk8\""
Jul 08 20:00:31.316624 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.316555    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 20:00:31.394648 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.394611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:31.394825 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:31.394685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:31.394825 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:31.394798    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:00:31.394943 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:31.394879    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:33.394858137 +0000 UTC m=+39.605864761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:00:31.394943 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:31.394799    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:00:31.394943 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:31.394907    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:00:31.395090 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:31.394982    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:33.394963903 +0000 UTC m=+39.605970522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:00:32.891426 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:32.891389    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:32.999821 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:32.999784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:33.103920 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:33.103884    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:33.220980 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:33.220896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:33.348129 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:33.348081    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:33.412793 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:33.412755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:33.412948 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:33.412829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:33.412948 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:33.412916    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:00:33.412948 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:33.412927    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:00:33.412948 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:33.412932    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:00:33.413069 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:33.412980    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:37.412967755 +0000 UTC m=+43.623974358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:00:33.413069 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:33.412995    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:37.412989119 +0000 UTC m=+43.623995723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:00:33.897199 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:33.897166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:34.451367 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:34.451310    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:34.472534 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:34.472498    2582 generic.go:356] "Generic (PLEG): container finished" podID="7727a3af-2ec8-404c-8b42-72d979865c67" containerID="e1c93e6a927d267ffa7dc666aca88fa593d0111b86bf5ca41b1ab51676cda6ca" exitCode=0
Jul 08 20:00:34.472706 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:34.472582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerDied","Data":"e1c93e6a927d267ffa7dc666aca88fa593d0111b86bf5ca41b1ab51676cda6ca"}
Jul 08 20:00:34.474078 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:34.474056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m2rhg" event={"ID":"69078ca8-87fd-444c-9383-8ba19d928474","Type":"ContainerStarted","Data":"03e660e3b83bc048970a02af95d50319a567c7ec17a95c45ac60a86f7ea9069f"}
Jul 08 20:00:34.518033 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:34.517985    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m2rhg" podStartSLOduration=2.102500296 podStartE2EDuration="5.517970232s" totalImagesPullingTime="3.415469936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:34.517192941 +0000 UTC m=+40.728199569" watchObservedRunningTime="2026-07-08 20:00:34.517970232 +0000 UTC m=+40.728976857"
Jul 08 20:00:34.521894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:34.521871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:35.478974 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:35.478944    2582 generic.go:356] "Generic (PLEG): container finished" podID="7727a3af-2ec8-404c-8b42-72d979865c67" containerID="ae9ccef28c193c08377f4c8a8cf0b82876738a19848c76ce8e754b68a50bf42f" exitCode=0
Jul 08 20:00:35.479334 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:35.479032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerDied","Data":"ae9ccef28c193c08377f4c8a8cf0b82876738a19848c76ce8e754b68a50bf42f"}
Jul 08 20:00:36.484550 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:36.484521    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" event={"ID":"7727a3af-2ec8-404c-8b42-72d979865c67","Type":"ContainerStarted","Data":"64cbcf7fb6e0ba635c3f5c74135ea45b5d48ae7de4b605418d02fe3ed742e549"}
Jul 08 20:00:36.517979 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:36.517919    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rtwdx" podStartSLOduration=8.79163077 podStartE2EDuration="42.517902834s" totalImagesPullingTime="33.726272064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:00:36.516378209 +0000 UTC m=+42.727384935" watchObservedRunningTime="2026-07-08 20:00:36.517902834 +0000 UTC m=+42.728909461"
Jul 08 20:00:36.664791 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:36.664756    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:36.762868 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:36.762788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:37.444007 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:37.443967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:37.444154 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:37.444072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:37.444154 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:37.444134    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:00:37.444154 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:37.444153    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:00:37.444261 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:37.444177    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:00:37.444261 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:37.444218    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:45.44420033 +0000 UTC m=+51.655206950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:00:37.444261 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:37.444232    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:45.444226345 +0000 UTC m=+51.655232952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:00:39.484893 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:39.484858    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:39.588618 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:39.588591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:41.499117 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:41.499079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:41.598917 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:41.598887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:45.486460 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:45.486430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:45.505865 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:45.505827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:00:45.506040 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:45.505893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:00:45.506040 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:45.506005    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:00:45.506040 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:45.506015    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:00:45.506040 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:45.506028    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:00:45.506230 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:45.506081    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:01.506063235 +0000 UTC m=+67.717069839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:00:45.506230 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:45.506097    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:01.506090029 +0000 UTC m=+67.717096633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:00:45.586977 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:45.586944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:49.995494 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:49.995452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:50.064658 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:50.064586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log" limit=1024
Jul 08 20:00:52.148086 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.148049    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"]
Jul 08 20:00:52.152411 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.152394    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.158165 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.158141    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 08 20:00:52.163588 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.163567    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 20:00:52.164808 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.164793    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f8dxm\""
Jul 08 20:00:52.165429 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.165412    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 20:00:52.168528 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.168510    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 08 20:00:52.187560 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.187532    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"]
Jul 08 20:00:52.258531 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.258495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2d003e6-8881-4b13-a624-da375c6d57f3-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.258697 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.258557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.258697 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.258617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrp8k\" (UniqueName: \"kubernetes.io/projected/f2d003e6-8881-4b13-a624-da375c6d57f3-kube-api-access-mrp8k\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.359257 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.359215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.359472 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.359307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrp8k\" (UniqueName: \"kubernetes.io/projected/f2d003e6-8881-4b13-a624-da375c6d57f3-kube-api-access-mrp8k\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.359472 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.359365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2d003e6-8881-4b13-a624-da375c6d57f3-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.359472 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:52.359385    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:52.359472 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:52.359457    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls podName:f2d003e6-8881-4b13-a624-da375c6d57f3 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:52.859441279 +0000 UTC m=+59.070447887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xv26s" (UID: "f2d003e6-8881-4b13-a624-da375c6d57f3") : secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:52.360085 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.360060    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2d003e6-8881-4b13-a624-da375c6d57f3-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.380457 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.380435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrp8k\" (UniqueName: \"kubernetes.io/projected/f2d003e6-8881-4b13-a624-da375c6d57f3-kube-api-access-mrp8k\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.862857 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:52.862816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:52.863044 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:52.862976    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:52.863086 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:52.863054    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls podName:f2d003e6-8881-4b13-a624-da375c6d57f3 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:53.863037531 +0000 UTC m=+60.074044156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xv26s" (UID: "f2d003e6-8881-4b13-a624-da375c6d57f3") : secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:53.869861 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:53.869803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:53.870258 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:53.869968    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:53.870258 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:53.870039    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls podName:f2d003e6-8881-4b13-a624-da375c6d57f3 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:55.870020818 +0000 UTC m=+62.081027439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xv26s" (UID: "f2d003e6-8881-4b13-a624-da375c6d57f3") : secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:54.457151 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:54.457123    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s8nf6"
Jul 08 20:00:55.885331 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:55.885270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:55.885742 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:55.885419    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:55.885742 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:55.885482    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls podName:f2d003e6-8881-4b13-a624-da375c6d57f3 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:59.885467103 +0000 UTC m=+66.096473707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xv26s" (UID: "f2d003e6-8881-4b13-a624-da375c6d57f3") : secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:57.368892 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.368857    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"]
Jul 08 20:00:57.372552 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.372533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"
Jul 08 20:00:57.375239 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.375213    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 20:00:57.375239 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.375217    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 20:00:57.376553 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.376530    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dvk5d\""
Jul 08 20:00:57.389038 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.389011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"]
Jul 08 20:00:57.396424 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.396403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drq4d\" (UniqueName: \"kubernetes.io/projected/3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4-kube-api-access-drq4d\") pod \"migrator-d57d58cc9-vl8qr\" (UID: \"3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"
Jul 08 20:00:57.497208 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.497171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drq4d\" (UniqueName: \"kubernetes.io/projected/3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4-kube-api-access-drq4d\") pod \"migrator-d57d58cc9-vl8qr\" (UID: \"3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"
Jul 08 20:00:57.505688 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.505657    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drq4d\" (UniqueName: \"kubernetes.io/projected/3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4-kube-api-access-drq4d\") pod \"migrator-d57d58cc9-vl8qr\" (UID: \"3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"
Jul 08 20:00:57.684889 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.684785    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"
Jul 08 20:00:57.806182 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.806139    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr"]
Jul 08 20:00:57.810054 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:00:57.810021    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fad1ae9_d801_4cb5_b630_bc1b80c6d4a4.slice/crio-2c6535bc0a8127032fcc26111b5a2bda8170794fb3650e6f11d2d05e49e00738 WatchSource:0}: Error finding container 2c6535bc0a8127032fcc26111b5a2bda8170794fb3650e6f11d2d05e49e00738: Status 404 returned error can't find the container with id 2c6535bc0a8127032fcc26111b5a2bda8170794fb3650e6f11d2d05e49e00738
Jul 08 20:00:57.887665 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.887632    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sghd2"]
Jul 08 20:00:57.891163 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.891147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:57.894018 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.893978    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-48jvt\""
Jul 08 20:00:57.894018 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.894010    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 20:00:57.894209 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.894170    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 20:00:57.894941 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.894925    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 20:00:57.895009 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.894928    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 20:00:57.902873 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:57.902853    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sghd2"]
Jul 08 20:00:58.001810 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.001711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.001810 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.001788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42e58975-3b19-496b-88d4-3cdd606358d7-crio-socket\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.002038 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.001853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fr2\" (UniqueName: \"kubernetes.io/projected/42e58975-3b19-496b-88d4-3cdd606358d7-kube-api-access-l7fr2\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.002038 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.001906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e58975-3b19-496b-88d4-3cdd606358d7-data-volume\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.002038 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.001945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.070337 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.070281    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"]
Jul 08 20:00:58.072911 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.072889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"
Jul 08 20:00:58.075552 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.075535    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5czlq\""
Jul 08 20:00:58.075701 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.075680    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 08 20:00:58.076091 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.076076    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 08 20:00:58.087580 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.087553    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"]
Jul 08 20:00:58.102971 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.102939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e58975-3b19-496b-88d4-3cdd606358d7-data-volume\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103166 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.102977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103166 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.103034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103166 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.103075    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 20:00:58.103166 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.103106    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 20:00:58.103166 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.103149    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:58.60312817 +0000 UTC m=+64.814134793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : secret "insights-runtime-extractor-tls" not found
Jul 08 20:00:58.103437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.103178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42e58975-3b19-496b-88d4-3cdd606358d7-crio-socket\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103437 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.103218    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:58.603202888 +0000 UTC m=+64.814209492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : configmap "kube-rbac-proxy" not found
Jul 08 20:00:58.103437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.103252    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42e58975-3b19-496b-88d4-3cdd606358d7-crio-socket\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.103269    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42e58975-3b19-496b-88d4-3cdd606358d7-data-volume\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.103278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fr2\" (UniqueName: \"kubernetes.io/projected/42e58975-3b19-496b-88d4-3cdd606358d7-kube-api-access-l7fr2\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.103437 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.103306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p68m5\" (UniqueName: \"kubernetes.io/projected/d9bac5f6-ba80-4473-aba3-ed383a637b3f-kube-api-access-p68m5\") pod \"volume-data-source-validator-5d456fdbcd-cx5g5\" (UID: \"d9bac5f6-ba80-4473-aba3-ed383a637b3f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"
Jul 08 20:00:58.115829 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.115808    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fr2\" (UniqueName: \"kubernetes.io/projected/42e58975-3b19-496b-88d4-3cdd606358d7-kube-api-access-l7fr2\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.204787 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.204734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p68m5\" (UniqueName: \"kubernetes.io/projected/d9bac5f6-ba80-4473-aba3-ed383a637b3f-kube-api-access-p68m5\") pod \"volume-data-source-validator-5d456fdbcd-cx5g5\" (UID: \"d9bac5f6-ba80-4473-aba3-ed383a637b3f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"
Jul 08 20:00:58.214127 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.214100    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p68m5\" (UniqueName: \"kubernetes.io/projected/d9bac5f6-ba80-4473-aba3-ed383a637b3f-kube-api-access-p68m5\") pod \"volume-data-source-validator-5d456fdbcd-cx5g5\" (UID: \"d9bac5f6-ba80-4473-aba3-ed383a637b3f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"
Jul 08 20:00:58.381756 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.381720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"
Jul 08 20:00:58.502949 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.502916    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5"]
Jul 08 20:00:58.506668 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:00:58.506641    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bac5f6_ba80_4473_aba3_ed383a637b3f.slice/crio-304bde90953ac5ac2d846a5ac53c6afb4c7faaad617e6273979c09571ea66291 WatchSource:0}: Error finding container 304bde90953ac5ac2d846a5ac53c6afb4c7faaad617e6273979c09571ea66291: Status 404 returned error can't find the container with id 304bde90953ac5ac2d846a5ac53c6afb4c7faaad617e6273979c09571ea66291
Jul 08 20:00:58.538541 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.538503    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5" event={"ID":"d9bac5f6-ba80-4473-aba3-ed383a637b3f","Type":"ContainerStarted","Data":"304bde90953ac5ac2d846a5ac53c6afb4c7faaad617e6273979c09571ea66291"}
Jul 08 20:00:58.539507 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.539483    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr" event={"ID":"3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4","Type":"ContainerStarted","Data":"2c6535bc0a8127032fcc26111b5a2bda8170794fb3650e6f11d2d05e49e00738"}
Jul 08 20:00:58.608224 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.608185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.608447 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.608296    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 20:00:58.608447 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:58.608347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:58.608447 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.608399    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:59.608375642 +0000 UTC m=+65.819382250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : configmap "kube-rbac-proxy" not found
Jul 08 20:00:58.608633 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.608461    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 20:00:58.608633 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:58.608526    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:00:59.608509119 +0000 UTC m=+65.819515727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : secret "insights-runtime-extractor-tls" not found
Jul 08 20:00:59.544184 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.544151    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr" event={"ID":"3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4","Type":"ContainerStarted","Data":"0cb49dcd82b3abb77ff312b9a5deed5091cabe44bc3124849ba99477fab97b7c"}
Jul 08 20:00:59.615204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.615150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:59.615367 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:59.615282    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 20:00:59.615422 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:59.615369    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:01.615349906 +0000 UTC m=+67.826356524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : configmap "kube-rbac-proxy" not found
Jul 08 20:00:59.615422 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:59.615385    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 20:00:59.615422 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.615271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:00:59.615539 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:59.615429    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:01.615416129 +0000 UTC m=+67.826422734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : secret "insights-runtime-extractor-tls" not found
Jul 08 20:00:59.917641 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.917598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:00:59.917814 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:59.917787    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:59.917899 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:00:59.917871    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls podName:f2d003e6-8881-4b13-a624-da375c6d57f3 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:07.917852382 +0000 UTC m=+74.128858986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xv26s" (UID: "f2d003e6-8881-4b13-a624-da375c6d57f3") : secret "cluster-monitoring-operator-tls" not found
Jul 08 20:00:59.933078 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.933044    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xx7c2"]
Jul 08 20:00:59.935994 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.935977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:00:59.940077 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.940057    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7ngc7\""
Jul 08 20:00:59.941350 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.941310    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 20:00:59.941350 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.941344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 20:00:59.941529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.941390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 20:00:59.941529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.941397    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 20:00:59.957088 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:00:59.957060    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xx7c2"]
Jul 08 20:01:00.018230 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.018190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:01:00.018230 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.018231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6a15575e-f437-496d-addf-42fa40b3c337-signing-cabundle\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.018466 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.018260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6a15575e-f437-496d-addf-42fa40b3c337-signing-key\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.018466 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.018283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72xhs\" (UniqueName: \"kubernetes.io/projected/6a15575e-f437-496d-addf-42fa40b3c337-kube-api-access-72xhs\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.018466 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.018430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:01:00.022518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.022493    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 20:01:00.022518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.022514    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 20:01:00.029103 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:00.029084    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 20:01:00.029215 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:00.029144    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs podName:feb7733f-2a25-481b-8c31-9477c1e451cc nodeName:}" failed. No retries permitted until 2026-07-08 20:02:04.029128183 +0000 UTC m=+130.240134787 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs") pod "network-metrics-daemon-jmwmx" (UID: "feb7733f-2a25-481b-8c31-9477c1e451cc") : secret "metrics-daemon-secret" not found
Jul 08 20:01:00.031426 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.031404    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54-original-pull-secret\") pod \"global-pull-secret-syncer-7xrb4\" (UID: \"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54\") " pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:01:00.119120 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.119078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:01:00.119291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.119152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6a15575e-f437-496d-addf-42fa40b3c337-signing-cabundle\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.119291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.119177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6a15575e-f437-496d-addf-42fa40b3c337-signing-key\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.119291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.119197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72xhs\" (UniqueName: \"kubernetes.io/projected/6a15575e-f437-496d-addf-42fa40b3c337-kube-api-access-72xhs\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.119849 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.119821    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6a15575e-f437-496d-addf-42fa40b3c337-signing-cabundle\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.121575 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.121554    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6a15575e-f437-496d-addf-42fa40b3c337-signing-key\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.122119 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.122103    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 20:01:00.125404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.125387    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xrb4"
Jul 08 20:01:00.133156 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.133134    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 20:01:00.133377 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.133361    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72xhs\" (UniqueName: \"kubernetes.io/projected/6a15575e-f437-496d-addf-42fa40b3c337-kube-api-access-72xhs\") pod \"service-ca-758f599c5-xx7c2\" (UID: \"6a15575e-f437-496d-addf-42fa40b3c337\") " pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.143054 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.143033    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p8qc\" (UniqueName: \"kubernetes.io/projected/83379520-a9e5-4389-b1a4-90178b34a150-kube-api-access-5p8qc\") pod \"network-check-target-9lnq9\" (UID: \"83379520-a9e5-4389-b1a4-90178b34a150\") " pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:01:00.244158 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.244126    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7xrb4"]
Jul 08 20:01:00.244310 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.244179    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xx7c2"
Jul 08 20:01:00.247056 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:00.247031    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73cd7ac_b968_4aff_a0b6_c0b1f6a06e54.slice/crio-810da96adc9abc337fd5bb06f50a3b2da7ce9e41c29e5cca7a096d9e479fd70a WatchSource:0}: Error finding container 810da96adc9abc337fd5bb06f50a3b2da7ce9e41c29e5cca7a096d9e479fd70a: Status 404 returned error can't find the container with id 810da96adc9abc337fd5bb06f50a3b2da7ce9e41c29e5cca7a096d9e479fd70a
Jul 08 20:01:00.287327 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.287288    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vxzk5_2dcbe74c-c83b-4c8c-8f27-301b2a346c64/dns-node-resolver/0.log"
Jul 08 20:01:00.435123 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.435039    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sqvk8\""
Jul 08 20:01:00.442816 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.442788    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:01:00.548873 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.548841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7xrb4" event={"ID":"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54","Type":"ContainerStarted","Data":"810da96adc9abc337fd5bb06f50a3b2da7ce9e41c29e5cca7a096d9e479fd70a"}
Jul 08 20:01:00.550872 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.550842    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr" event={"ID":"3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4","Type":"ContainerStarted","Data":"40c7aa252abdb6056c35d258ae757c601a2f49b9227172fac44d315e07352a35"}
Jul 08 20:01:00.595153 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.595104    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-vl8qr" podStartSLOduration=1.9412727159999998 podStartE2EDuration="3.595084045s" totalImagesPullingTime="1.653811329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:00.594963288 +0000 UTC m=+66.805969916" watchObservedRunningTime="2026-07-08 20:01:00.595084045 +0000 UTC m=+66.806090672"
Jul 08 20:01:00.607737 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.607710    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9lnq9"]
Jul 08 20:01:00.611037 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:00.611012    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83379520_a9e5_4389_b1a4_90178b34a150.slice/crio-90ff2472a4339cecc7f1b1d64b9c8b61d58714a77f7d58dc2e4c08ad7258eebd WatchSource:0}: Error finding container 90ff2472a4339cecc7f1b1d64b9c8b61d58714a77f7d58dc2e4c08ad7258eebd: Status 404 returned error can't find the container with id 90ff2472a4339cecc7f1b1d64b9c8b61d58714a77f7d58dc2e4c08ad7258eebd
Jul 08 20:01:00.614018 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:00.613997    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xx7c2"]
Jul 08 20:01:00.617438 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:00.617398    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a15575e_f437_496d_addf_42fa40b3c337.slice/crio-e8ea9f81772293f7aa0a15fe0655d0b14e4f95b08887860ee615ab0eeeb9c07b WatchSource:0}: Error finding container e8ea9f81772293f7aa0a15fe0655d0b14e4f95b08887860ee615ab0eeeb9c07b: Status 404 returned error can't find the container with id e8ea9f81772293f7aa0a15fe0655d0b14e4f95b08887860ee615ab0eeeb9c07b
Jul 08 20:01:01.087102 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.087077    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95ggm_ecb31af8-ee41-4f4b-9b7d-819c4606e4f9/node-ca/0.log"
Jul 08 20:01:01.530285 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.530184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:01:01.530475 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.530348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:01:01.530475 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.530375    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 20:01:01.530475 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.530447    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls podName:656f74cf-0962-49ad-84b0-7b49bddaf406 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:33.530427451 +0000 UTC m=+99.741434060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls") pod "dns-default-2x9jp" (UID: "656f74cf-0962-49ad-84b0-7b49bddaf406") : secret "dns-default-metrics-tls" not found
Jul 08 20:01:01.530653 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.530539    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 20:01:01.530653 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.530555    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78d9c465fd-vzs6l: secret "image-registry-tls" not found
Jul 08 20:01:01.530653 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.530612    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls podName:0af205fc-e910-4446-8bf0-a82aac21b662 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:33.530595854 +0000 UTC m=+99.741602461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls") pod "image-registry-78d9c465fd-vzs6l" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662") : secret "image-registry-tls" not found
Jul 08 20:01:01.556477 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.556397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5" event={"ID":"d9bac5f6-ba80-4473-aba3-ed383a637b3f","Type":"ContainerStarted","Data":"d8ad34f8154b4609520d703c59a5128fd47bc4d06960a80b254c25fea1868179"}
Jul 08 20:01:01.558248 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.558218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xx7c2" event={"ID":"6a15575e-f437-496d-addf-42fa40b3c337","Type":"ContainerStarted","Data":"e8ea9f81772293f7aa0a15fe0655d0b14e4f95b08887860ee615ab0eeeb9c07b"}
Jul 08 20:01:01.560061 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.560032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9lnq9" event={"ID":"83379520-a9e5-4389-b1a4-90178b34a150","Type":"ContainerStarted","Data":"90ff2472a4339cecc7f1b1d64b9c8b61d58714a77f7d58dc2e4c08ad7258eebd"}
Jul 08 20:01:01.576310 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.576251    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cx5g5" podStartSLOduration=1.575033496 podStartE2EDuration="3.576228461s" totalImagesPullingTime="2.001194965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:01.574967904 +0000 UTC m=+67.785974534" watchObservedRunningTime="2026-07-08 20:01:01.576228461 +0000 UTC m=+67.787235088"
Jul 08 20:01:01.632336 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.631786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:01.632336 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.631865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:01.632336 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.631957    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 20:01:01.632336 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.632032    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:05.632012516 +0000 UTC m=+71.843019143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : secret "insights-runtime-extractor-tls" not found
Jul 08 20:01:01.632692 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.632417    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 20:01:01.632692 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:01.632466    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:05.632451647 +0000 UTC m=+71.843458265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : configmap "kube-rbac-proxy" not found
Jul 08 20:01:01.688511 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:01.688479    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2rhg_69078ca8-87fd-444c-9383-8ba19d928474/serve-healthcheck-canary/0.log"
Jul 08 20:01:02.088804 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:02.088778    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vl8qr_3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4/migrator/0.log"
Jul 08 20:01:02.290904 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:02.290870    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vl8qr_3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4/graceful-termination/0.log"
Jul 08 20:01:04.570593 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:04.570543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xx7c2" event={"ID":"6a15575e-f437-496d-addf-42fa40b3c337","Type":"ContainerStarted","Data":"e2b46149171eee706eada4ad3e42462f63687e6de09a194bfe9c0a59bb3235b0"}
Jul 08 20:01:04.572363 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:04.572335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9lnq9" event={"ID":"83379520-a9e5-4389-b1a4-90178b34a150","Type":"ContainerStarted","Data":"36158e7adeca5c4a64c1c36e00e685245572635d48879d72bd28ef23b0651650"}
Jul 08 20:01:04.572489 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:04.572471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:01:04.588959 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:04.588791    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-xx7c2" podStartSLOduration=1.816920333 podStartE2EDuration="5.588772446s" totalImagesPullingTime="3.771852113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:04.588185175 +0000 UTC m=+70.799191804" watchObservedRunningTime="2026-07-08 20:01:04.588772446 +0000 UTC m=+70.799779072"
Jul 08 20:01:04.609963 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:04.609902    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9lnq9" podStartSLOduration=66.828845023 podStartE2EDuration="1m10.609878039s" totalImagesPullingTime="3.781033016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:04.608165931 +0000 UTC m=+70.819172550" watchObservedRunningTime="2026-07-08 20:01:04.609878039 +0000 UTC m=+70.820884647"
Jul 08 20:01:05.668154 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:05.667924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:05.668154 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:05.667999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:05.668154 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:05.668074    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 20:01:05.668154 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:05.668152    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:13.668129869 +0000 UTC m=+79.879136494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : secret "insights-runtime-extractor-tls" not found
Jul 08 20:01:05.668769 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:05.668185    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 20:01:05.668769 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:05.668264    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:13.66824662 +0000 UTC m=+79.879253231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : configmap "kube-rbac-proxy" not found
Jul 08 20:01:07.585189 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:07.585153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7xrb4" event={"ID":"d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54","Type":"ContainerStarted","Data":"65769bf5608b4011cb91cc4c663f66d8bad303379f085c334d353dac8964d790"}
Jul 08 20:01:07.603334 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:07.603276    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7xrb4" podStartSLOduration=67.381639787 podStartE2EDuration="1m13.603260194s" totalImagesPullingTime="6.221620407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:07.602256141 +0000 UTC m=+73.813262770" watchObservedRunningTime="2026-07-08 20:01:07.603260194 +0000 UTC m=+73.814266821"
Jul 08 20:01:07.987176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:07.987070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:01:07.987387 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:07.987239    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 20:01:07.987387 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:07.987345    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls podName:f2d003e6-8881-4b13-a624-da375c6d57f3 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:23.987303084 +0000 UTC m=+90.198309688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xv26s" (UID: "f2d003e6-8881-4b13-a624-da375c6d57f3") : secret "cluster-monitoring-operator-tls" not found
Jul 08 20:01:13.737860 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:13.737813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:13.738358 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:13.737871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:13.738358 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:13.737982    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 20:01:13.738358 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:13.738076    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls podName:42e58975-3b19-496b-88d4-3cdd606358d7 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:29.738059385 +0000 UTC m=+95.949065988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sghd2" (UID: "42e58975-3b19-496b-88d4-3cdd606358d7") : secret "insights-runtime-extractor-tls" not found
Jul 08 20:01:13.738486 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:13.738420    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42e58975-3b19-496b-88d4-3cdd606358d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:21.643689 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.643570    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"]
Jul 08 20:01:21.647880 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.647857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"
Jul 08 20:01:21.649017 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.648994    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"]
Jul 08 20:01:21.651443 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.651424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8sndn\""
Jul 08 20:01:21.651802 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.651786    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.654601 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.654581    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 20:01:21.654680 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.654603    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 20:01:21.654680 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.654628    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 20:01:21.655766 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.655746    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vzgxv\""
Jul 08 20:01:21.655766 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.655747    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 20:01:21.663866 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.663842    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"]
Jul 08 20:01:21.667069 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.667047    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"]
Jul 08 20:01:21.667243 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.667188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.667351 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.667216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"]
Jul 08 20:01:21.671082 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.671065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 20:01:21.673051 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.673034    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 20:01:21.673756 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.673742    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 20:01:21.673852 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.673833    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 20:01:21.694868 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.694830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"]
Jul 08 20:01:21.807445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.807445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.807652 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5xh\" (UniqueName: \"kubernetes.io/projected/ba7edce3-6550-4834-8bb6-66c5487f0691-kube-api-access-vn5xh\") pod \"managed-serviceaccount-addon-agent-7558676dcb-ftd2m\" (UID: \"ba7edce3-6550-4834-8bb6-66c5487f0691\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.807652 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-ca\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.807652 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhkpq\" (UniqueName: \"kubernetes.io/projected/c7a854f1-e566-410d-a379-56ea8097ce7a-kube-api-access-fhkpq\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.807744 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a854f1-e566-410d-a379-56ea8097ce7a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.807744 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gdrm\" (UniqueName: \"kubernetes.io/projected/2446f077-a672-4bdf-b1e1-acfd692b492a-kube-api-access-4gdrm\") pod \"network-check-source-989f8b8dc-jb2tw\" (UID: \"2446f077-a672-4bdf-b1e1-acfd692b492a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"
Jul 08 20:01:21.807811 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba7edce3-6550-4834-8bb6-66c5487f0691-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7558676dcb-ftd2m\" (UID: \"ba7edce3-6550-4834-8bb6-66c5487f0691\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.807811 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.807777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-hub\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909086 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.908996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba7edce3-6550-4834-8bb6-66c5487f0691-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7558676dcb-ftd2m\" (UID: \"ba7edce3-6550-4834-8bb6-66c5487f0691\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.909086 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-hub\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909266 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909310 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909391 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5xh\" (UniqueName: \"kubernetes.io/projected/ba7edce3-6550-4834-8bb6-66c5487f0691-kube-api-access-vn5xh\") pod \"managed-serviceaccount-addon-agent-7558676dcb-ftd2m\" (UID: \"ba7edce3-6550-4834-8bb6-66c5487f0691\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.909445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-ca\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhkpq\" (UniqueName: \"kubernetes.io/projected/c7a854f1-e566-410d-a379-56ea8097ce7a-kube-api-access-fhkpq\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909547 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a854f1-e566-410d-a379-56ea8097ce7a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.909547 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.909537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gdrm\" (UniqueName: \"kubernetes.io/projected/2446f077-a672-4bdf-b1e1-acfd692b492a-kube-api-access-4gdrm\") pod \"network-check-source-989f8b8dc-jb2tw\" (UID: \"2446f077-a672-4bdf-b1e1-acfd692b492a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"
Jul 08 20:01:21.910288 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.910251    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7a854f1-e566-410d-a379-56ea8097ce7a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.911795 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.911769    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.912143 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.912120    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-ca\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.912250 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.912230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.912291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.912249    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c7a854f1-e566-410d-a379-56ea8097ce7a-hub\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.912291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.912230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ba7edce3-6550-4834-8bb6-66c5487f0691-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7558676dcb-ftd2m\" (UID: \"ba7edce3-6550-4834-8bb6-66c5487f0691\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.926604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.926577    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gdrm\" (UniqueName: \"kubernetes.io/projected/2446f077-a672-4bdf-b1e1-acfd692b492a-kube-api-access-4gdrm\") pod \"network-check-source-989f8b8dc-jb2tw\" (UID: \"2446f077-a672-4bdf-b1e1-acfd692b492a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"
Jul 08 20:01:21.926604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.926598    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhkpq\" (UniqueName: \"kubernetes.io/projected/c7a854f1-e566-410d-a379-56ea8097ce7a-kube-api-access-fhkpq\") pod \"cluster-proxy-proxy-agent-6674bb78fc-m89fm\" (UID: \"c7a854f1-e566-410d-a379-56ea8097ce7a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:21.926958 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.926937    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5xh\" (UniqueName: \"kubernetes.io/projected/ba7edce3-6550-4834-8bb6-66c5487f0691-kube-api-access-vn5xh\") pod \"managed-serviceaccount-addon-agent-7558676dcb-ftd2m\" (UID: \"ba7edce3-6550-4834-8bb6-66c5487f0691\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.958825 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.958791    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"
Jul 08 20:01:21.970497 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.970456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"
Jul 08 20:01:21.977686 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:21.977663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"
Jul 08 20:01:22.149206 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:22.149174    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2446f077_a672_4bdf_b1e1_acfd692b492a.slice/crio-dbdee13eb6f06e92243204d88353762e1182650d50f0aa0e32291bf7674d430f WatchSource:0}: Error finding container dbdee13eb6f06e92243204d88353762e1182650d50f0aa0e32291bf7674d430f: Status 404 returned error can't find the container with id dbdee13eb6f06e92243204d88353762e1182650d50f0aa0e32291bf7674d430f
Jul 08 20:01:22.149964 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.149943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw"]
Jul 08 20:01:22.370750 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.370718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m"]
Jul 08 20:01:22.371950 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.371812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm"]
Jul 08 20:01:22.374025 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:22.373994    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba7edce3_6550_4834_8bb6_66c5487f0691.slice/crio-718de0a0266cc64074d5f5c686a0266c891a0eb01b2ccb26062f1ab0deef3a95 WatchSource:0}: Error finding container 718de0a0266cc64074d5f5c686a0266c891a0eb01b2ccb26062f1ab0deef3a95: Status 404 returned error can't find the container with id 718de0a0266cc64074d5f5c686a0266c891a0eb01b2ccb26062f1ab0deef3a95
Jul 08 20:01:22.375450 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:22.375426    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7a854f1_e566_410d_a379_56ea8097ce7a.slice/crio-8dcc0b7c68f3a4f6f1b0e65f1b151dcce9dec3d97552489642f76a47ac2d41fa WatchSource:0}: Error finding container 8dcc0b7c68f3a4f6f1b0e65f1b151dcce9dec3d97552489642f76a47ac2d41fa: Status 404 returned error can't find the container with id 8dcc0b7c68f3a4f6f1b0e65f1b151dcce9dec3d97552489642f76a47ac2d41fa
Jul 08 20:01:22.635036 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.634992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm" event={"ID":"c7a854f1-e566-410d-a379-56ea8097ce7a","Type":"ContainerStarted","Data":"8dcc0b7c68f3a4f6f1b0e65f1b151dcce9dec3d97552489642f76a47ac2d41fa"}
Jul 08 20:01:22.636049 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.636025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m" event={"ID":"ba7edce3-6550-4834-8bb6-66c5487f0691","Type":"ContainerStarted","Data":"718de0a0266cc64074d5f5c686a0266c891a0eb01b2ccb26062f1ab0deef3a95"}
Jul 08 20:01:22.637407 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.637385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw" event={"ID":"2446f077-a672-4bdf-b1e1-acfd692b492a","Type":"ContainerStarted","Data":"2f58e5aafa4808882b94d3923c593833ed0ee6a0650dc49a95c4e1de5a850a6e"}
Jul 08 20:01:22.637527 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.637459    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw" event={"ID":"2446f077-a672-4bdf-b1e1-acfd692b492a","Type":"ContainerStarted","Data":"dbdee13eb6f06e92243204d88353762e1182650d50f0aa0e32291bf7674d430f"}
Jul 08 20:01:22.668365 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:22.668160    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jb2tw" podStartSLOduration=1.6681455760000001 podStartE2EDuration="1.668145576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:22.668093949 +0000 UTC m=+88.879100631" watchObservedRunningTime="2026-07-08 20:01:22.668145576 +0000 UTC m=+88.879152203"
Jul 08 20:01:24.030246 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:24.030199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:01:24.033269 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:24.033236    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2d003e6-8881-4b13-a624-da375c6d57f3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xv26s\" (UID: \"f2d003e6-8881-4b13-a624-da375c6d57f3\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:01:24.264070 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:24.264035    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f8dxm\""
Jul 08 20:01:24.271941 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:24.271911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"
Jul 08 20:01:25.309332 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:25.309290    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s"]
Jul 08 20:01:25.312362 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:25.312332    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d003e6_8881_4b13_a624_da375c6d57f3.slice/crio-5f13389f12acfc8632217ebf601d3546484e0cff80cb6c56dbdd3a50cacc665a WatchSource:0}: Error finding container 5f13389f12acfc8632217ebf601d3546484e0cff80cb6c56dbdd3a50cacc665a: Status 404 returned error can't find the container with id 5f13389f12acfc8632217ebf601d3546484e0cff80cb6c56dbdd3a50cacc665a
Jul 08 20:01:25.651852 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:25.651797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m" event={"ID":"ba7edce3-6550-4834-8bb6-66c5487f0691","Type":"ContainerStarted","Data":"1a7a88d0ce45507b1f90ef62aab2375adcc31e15c6356a67b7833788aa331f57"}
Jul 08 20:01:25.653067 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:25.653040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s" event={"ID":"f2d003e6-8881-4b13-a624-da375c6d57f3","Type":"ContainerStarted","Data":"5f13389f12acfc8632217ebf601d3546484e0cff80cb6c56dbdd3a50cacc665a"}
Jul 08 20:01:25.668997 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:25.668938    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7558676dcb-ftd2m" podStartSLOduration=1.815440706 podStartE2EDuration="4.668913542s" totalImagesPullingTime="2.853472836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:25.668408236 +0000 UTC m=+91.879414864" watchObservedRunningTime="2026-07-08 20:01:25.668913542 +0000 UTC m=+91.879920169"
Jul 08 20:01:28.665124 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:28.665034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm" event={"ID":"c7a854f1-e566-410d-a379-56ea8097ce7a","Type":"ContainerStarted","Data":"95c057cc4e05a2409affb218149daafa35a1e487b95d9b2cf8d5a92aa3ac39cb"}
Jul 08 20:01:28.665124 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:28.665081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm" event={"ID":"c7a854f1-e566-410d-a379-56ea8097ce7a","Type":"ContainerStarted","Data":"be4e5aed23ef7d9d6f4996f248199525ef62bfc81dced442d9838123b77bf35e"}
Jul 08 20:01:28.665124 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:28.665098    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm" event={"ID":"c7a854f1-e566-410d-a379-56ea8097ce7a","Type":"ContainerStarted","Data":"042b25893a2b6d5f576d1d5f3514490d67b301a61f21341c0cd1e95005c00bb6"}
Jul 08 20:01:28.666719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:28.666696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s" event={"ID":"f2d003e6-8881-4b13-a624-da375c6d57f3","Type":"ContainerStarted","Data":"4be2167798b28049f051a26dcf3a602f29eef556cb34658bcb6fb3c28ae0ae76"}
Jul 08 20:01:28.689147 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:28.689094    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6674bb78fc-m89fm" podStartSLOduration=1.6860881810000001 podStartE2EDuration="7.68907927s" totalImagesPullingTime="6.002991089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:28.687392318 +0000 UTC m=+94.898398947" watchObservedRunningTime="2026-07-08 20:01:28.68907927 +0000 UTC m=+94.900085896"
Jul 08 20:01:28.715961 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:28.715908    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xv26s" podStartSLOduration=33.66140496 podStartE2EDuration="36.715889709s" totalImagesPullingTime="3.054484749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:28.714863181 +0000 UTC m=+94.925869804" watchObservedRunningTime="2026-07-08 20:01:28.715889709 +0000 UTC m=+94.926896335"
Jul 08 20:01:29.785648 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:29.785413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:29.787821 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:29.787793    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42e58975-3b19-496b-88d4-3cdd606358d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sghd2\" (UID: \"42e58975-3b19-496b-88d4-3cdd606358d7\") " pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:30.000330 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:30.000291    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sghd2"
Jul 08 20:01:30.129506 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:30.129471    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sghd2"]
Jul 08 20:01:30.676382 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:30.676334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sghd2" event={"ID":"42e58975-3b19-496b-88d4-3cdd606358d7","Type":"ContainerStarted","Data":"bc22ccf72012b0e1824c18418b6de61f454fd0fa8c82f6f873351c5b344bb8e0"}
Jul 08 20:01:33.620272 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.620225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:01:33.620692 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.620284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:01:33.622948 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.622921    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/656f74cf-0962-49ad-84b0-7b49bddaf406-metrics-tls\") pod \"dns-default-2x9jp\" (UID: \"656f74cf-0962-49ad-84b0-7b49bddaf406\") " pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:01:33.623072 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.622980    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"image-registry-78d9c465fd-vzs6l\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") " pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:01:33.828422 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.828358    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-62jd7\""
Jul 08 20:01:33.836037 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.836017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:01:33.845689 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.845662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-psksh\""
Jul 08 20:01:33.853215 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:33.853197    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:01:34.005551 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.005516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2x9jp"]
Jul 08 20:01:34.008481 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:34.008449    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656f74cf_0962_49ad_84b0_7b49bddaf406.slice/crio-a450771e1e2ec95595da7afa504de5572540f0db99ae51a19cde2f8c45160b4e WatchSource:0}: Error finding container a450771e1e2ec95595da7afa504de5572540f0db99ae51a19cde2f8c45160b4e: Status 404 returned error can't find the container with id a450771e1e2ec95595da7afa504de5572540f0db99ae51a19cde2f8c45160b4e
Jul 08 20:01:34.025360 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.025332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78d9c465fd-vzs6l"]
Jul 08 20:01:34.027919 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:34.027892    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af205fc_e910_4446_8bf0_a82aac21b662.slice/crio-e0121e29c80abd2815818ef52a56666a91f72415c42c1c37ca8ef5b5999acc68 WatchSource:0}: Error finding container e0121e29c80abd2815818ef52a56666a91f72415c42c1c37ca8ef5b5999acc68: Status 404 returned error can't find the container with id e0121e29c80abd2815818ef52a56666a91f72415c42c1c37ca8ef5b5999acc68
Jul 08 20:01:34.692658 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.692625    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2x9jp" event={"ID":"656f74cf-0962-49ad-84b0-7b49bddaf406","Type":"ContainerStarted","Data":"a450771e1e2ec95595da7afa504de5572540f0db99ae51a19cde2f8c45160b4e"}
Jul 08 20:01:34.694581 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.694558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sghd2" event={"ID":"42e58975-3b19-496b-88d4-3cdd606358d7","Type":"ContainerStarted","Data":"7eb068ba55d64f2ba295c960124118943d2dbdb37779d02edf25fd3c1d678ba7"}
Jul 08 20:01:34.696014 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.695995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l" event={"ID":"0af205fc-e910-4446-8bf0-a82aac21b662","Type":"ContainerStarted","Data":"0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4"}
Jul 08 20:01:34.696095 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.696029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l" event={"ID":"0af205fc-e910-4446-8bf0-a82aac21b662","Type":"ContainerStarted","Data":"e0121e29c80abd2815818ef52a56666a91f72415c42c1c37ca8ef5b5999acc68"}
Jul 08 20:01:34.696152 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.696134    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:01:34.719491 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:34.719442    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l" podStartSLOduration=99.719426433 podStartE2EDuration="1m39.719426433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:34.718595522 +0000 UTC m=+100.929602149" watchObservedRunningTime="2026-07-08 20:01:34.719426433 +0000 UTC m=+100.930433059"
Jul 08 20:01:35.579634 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:35.579604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9lnq9"
Jul 08 20:01:35.702925 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:35.702882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sghd2" event={"ID":"42e58975-3b19-496b-88d4-3cdd606358d7","Type":"ContainerStarted","Data":"5f08897b00fb39a0de767bfd4256f626473546c30f3a21df26b6665b4d94ea66"}
Jul 08 20:01:38.715329 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:38.715280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sghd2" event={"ID":"42e58975-3b19-496b-88d4-3cdd606358d7","Type":"ContainerStarted","Data":"ae7b6b2574057c5947a49fe556e175921f0e7dbf5a040dcb42ea4c6c34a56480"}
Jul 08 20:01:38.717078 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:38.717050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2x9jp" event={"ID":"656f74cf-0962-49ad-84b0-7b49bddaf406","Type":"ContainerStarted","Data":"23c6a6a4a0623dba4e002a5930803608f13659c96947f6d67a08fd284b41cb48"}
Jul 08 20:01:38.717210 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:38.717110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2x9jp" event={"ID":"656f74cf-0962-49ad-84b0-7b49bddaf406","Type":"ContainerStarted","Data":"06394cebf3b9a861e3546771b7885497fa6e0972b5b5da35daa7df7fea270cd3"}
Jul 08 20:01:38.717210 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:38.717145    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:01:38.743069 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:38.742960    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sghd2" podStartSLOduration=33.52485517 podStartE2EDuration="41.742944115s" totalImagesPullingTime="8.218088945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 20:00:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:38.74255203 +0000 UTC m=+104.953558655" watchObservedRunningTime="2026-07-08 20:01:38.742944115 +0000 UTC m=+104.953950740"
Jul 08 20:01:42.518142 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.518086    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2x9jp" podStartSLOduration=69.329100977 podStartE2EDuration="1m13.518067505s" totalImagesPullingTime="4.188966528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:38.768280958 +0000 UTC m=+104.979287588" watchObservedRunningTime="2026-07-08 20:01:42.518067505 +0000 UTC m=+108.729074125"
Jul 08 20:01:42.518792 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.518773    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-79wdj"]
Jul 08 20:01:42.522835 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.522816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.525697 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.525670    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 20:01:42.525819 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.525709    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 20:01:42.525819 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.525751    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 20:01:42.528728 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.528709    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 20:01:42.528899 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.528880    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hvx2f\""
Jul 08 20:01:42.591886 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.591850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ac98df1-1b56-4f03-831a-a097cce4bb06-metrics-client-ca\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592074 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.591892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-sys\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592074 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.591931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-textfile\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592074 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.591957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592074 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.591987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-tls\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592074 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.592008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-wtmp\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592074 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.592064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-root\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592398 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.592087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-accelerators-collector-config\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.592398 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.592126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4scn\" (UniqueName: \"kubernetes.io/projected/7ac98df1-1b56-4f03-831a-a097cce4bb06-kube-api-access-b4scn\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692682 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ac98df1-1b56-4f03-831a-a097cce4bb06-metrics-client-ca\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692682 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-sys\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692933 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692754    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-sys\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692933 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-textfile\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692933 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692933 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-tls\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.692933 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-wtmp\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-root\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.692984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-accelerators-collector-config\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693176 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:42.693003    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 20:01:42.693176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.693031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4scn\" (UniqueName: \"kubernetes.io/projected/7ac98df1-1b56-4f03-831a-a097cce4bb06-kube-api-access-b4scn\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693176 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:01:42.693082    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-tls podName:7ac98df1-1b56-4f03-831a-a097cce4bb06 nodeName:}" failed. No retries permitted until 2026-07-08 20:01:43.193058959 +0000 UTC m=+109.404065563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-tls") pod "node-exporter-79wdj" (UID: "7ac98df1-1b56-4f03-831a-a097cce4bb06") : secret "node-exporter-tls" not found
Jul 08 20:01:42.693476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.693208    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-textfile\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.693291    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-root\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.693346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ac98df1-1b56-4f03-831a-a097cce4bb06-metrics-client-ca\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.693385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-wtmp\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.693772 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.693749    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-accelerators-collector-config\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.695218 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.695197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:42.708716 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:42.708686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4scn\" (UniqueName: \"kubernetes.io/projected/7ac98df1-1b56-4f03-831a-a097cce4bb06-kube-api-access-b4scn\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:43.197676 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:43.197637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-tls\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:43.199925 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:43.199897    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ac98df1-1b56-4f03-831a-a097cce4bb06-node-exporter-tls\") pod \"node-exporter-79wdj\" (UID: \"7ac98df1-1b56-4f03-831a-a097cce4bb06\") " pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:43.432720 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:43.432689    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79wdj"
Jul 08 20:01:43.444067 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:01:43.444037    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac98df1_1b56_4f03_831a_a097cce4bb06.slice/crio-bb1ac35c24d2fd345f0b37d4a4064a6921010ae091b9cc5b5d65fb039200d205 WatchSource:0}: Error finding container bb1ac35c24d2fd345f0b37d4a4064a6921010ae091b9cc5b5d65fb039200d205: Status 404 returned error can't find the container with id bb1ac35c24d2fd345f0b37d4a4064a6921010ae091b9cc5b5d65fb039200d205
Jul 08 20:01:43.736334 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:43.736292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79wdj" event={"ID":"7ac98df1-1b56-4f03-831a-a097cce4bb06","Type":"ContainerStarted","Data":"bb1ac35c24d2fd345f0b37d4a4064a6921010ae091b9cc5b5d65fb039200d205"}
Jul 08 20:01:44.741693 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:44.741656    2582 generic.go:356] "Generic (PLEG): container finished" podID="7ac98df1-1b56-4f03-831a-a097cce4bb06" containerID="c4ce14d90bb9dc740a4ea94e806369b200f21447a3a428d703ff59b83d03592b" exitCode=0
Jul 08 20:01:44.742062 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:44.741725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79wdj" event={"ID":"7ac98df1-1b56-4f03-831a-a097cce4bb06","Type":"ContainerDied","Data":"c4ce14d90bb9dc740a4ea94e806369b200f21447a3a428d703ff59b83d03592b"}
Jul 08 20:01:45.747337 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:45.747281    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79wdj" event={"ID":"7ac98df1-1b56-4f03-831a-a097cce4bb06","Type":"ContainerStarted","Data":"15e0fed53db43887cfbd390881398152c5e243b15fd799e737914ccf6bb83249"}
Jul 08 20:01:45.747687 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:45.747364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79wdj" event={"ID":"7ac98df1-1b56-4f03-831a-a097cce4bb06","Type":"ContainerStarted","Data":"4a52bcc261b7e7b1f42a3cd79e59f5186983b9f2732609900d2ac5d5a9f6345d"}
Jul 08 20:01:45.770140 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:45.770089    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-79wdj" podStartSLOduration=2.627014999 podStartE2EDuration="3.770074995s" totalImagesPullingTime="1.078656533s" totalInitContainerRuntime="64.403463ms" isStatefulPod=true podCreationTimestamp="2026-07-08 20:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:01:45.768099675 +0000 UTC m=+111.979106302" watchObservedRunningTime="2026-07-08 20:01:45.770074995 +0000 UTC m=+111.981081621"
Jul 08 20:01:48.722327 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:48.722284    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2x9jp"
Jul 08 20:01:53.531116 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:53.531079    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78d9c465fd-vzs6l"]
Jul 08 20:01:53.536604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:01:53.536574    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:02:04.067791 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:04.067746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:02:04.070060 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:04.070031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/feb7733f-2a25-481b-8c31-9477c1e451cc-metrics-certs\") pod \"network-metrics-daemon-jmwmx\" (UID: \"feb7733f-2a25-481b-8c31-9477c1e451cc\") " pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:02:04.226205 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:04.226179    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zs499\""
Jul 08 20:02:04.233814 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:04.233783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmwmx"
Jul 08 20:02:04.430491 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:04.430463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jmwmx"]
Jul 08 20:02:04.432873 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:02:04.432846    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb7733f_2a25_481b_8c31_9477c1e451cc.slice/crio-9d5281584d97285f1d9fe3884299c42d9a558d5f386fd12a26926e90be84b248 WatchSource:0}: Error finding container 9d5281584d97285f1d9fe3884299c42d9a558d5f386fd12a26926e90be84b248: Status 404 returned error can't find the container with id 9d5281584d97285f1d9fe3884299c42d9a558d5f386fd12a26926e90be84b248
Jul 08 20:02:04.810298 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:04.810258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmwmx" event={"ID":"feb7733f-2a25-481b-8c31-9477c1e451cc","Type":"ContainerStarted","Data":"9d5281584d97285f1d9fe3884299c42d9a558d5f386fd12a26926e90be84b248"}
Jul 08 20:02:06.818846 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:06.818807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmwmx" event={"ID":"feb7733f-2a25-481b-8c31-9477c1e451cc","Type":"ContainerStarted","Data":"d4d69db54fd182745308a38814f97b3538cd387adb350377910adede97a212c9"}
Jul 08 20:02:06.819249 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:06.818869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmwmx" event={"ID":"feb7733f-2a25-481b-8c31-9477c1e451cc","Type":"ContainerStarted","Data":"8b726a41930e0ef86cb3afe0a109eaa66f1fc15cb9be9914c7a76fe901380f74"}
Jul 08 20:02:06.836879 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:06.836830    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jmwmx" podStartSLOduration=131.515231541 podStartE2EDuration="2m12.836814174s" totalImagesPullingTime="1.321582633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:02:06.835962813 +0000 UTC m=+133.046969464" watchObservedRunningTime="2026-07-08 20:02:06.836814174 +0000 UTC m=+133.047820800"
Jul 08 20:02:18.551529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.551460    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l" podUID="0af205fc-e910-4446-8bf0-a82aac21b662" containerName="registry" containerID="cri-o://0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4" gracePeriod=30
Jul 08 20:02:18.806694 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.806633    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:02:18.862940 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.862903    2582 generic.go:356] "Generic (PLEG): container finished" podID="0af205fc-e910-4446-8bf0-a82aac21b662" containerID="0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4" exitCode=0
Jul 08 20:02:18.863115 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.862944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l" event={"ID":"0af205fc-e910-4446-8bf0-a82aac21b662","Type":"ContainerDied","Data":"0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4"}
Jul 08 20:02:18.863115 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.862952    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l"
Jul 08 20:02:18.863115 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.862981    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78d9c465fd-vzs6l" event={"ID":"0af205fc-e910-4446-8bf0-a82aac21b662","Type":"ContainerDied","Data":"e0121e29c80abd2815818ef52a56666a91f72415c42c1c37ca8ef5b5999acc68"}
Jul 08 20:02:18.863115 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.863001    2582 scope.go:117] "RemoveContainer" containerID="0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4"
Jul 08 20:02:18.870820 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.870805    2582 scope.go:117] "RemoveContainer" containerID="0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4"
Jul 08 20:02:18.871065 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:02:18.871047    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4\": container with ID starting with 0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4 not found: ID does not exist" containerID="0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4"
Jul 08 20:02:18.871107 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.871074    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4"} err="failed to get container status \"0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4\": rpc error: code = NotFound desc = could not find container \"0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4\": container with ID starting with 0e9bb3074bc74cfe5311503a7b9758845dc058c823fdce95c1c9ddc2a7341eb4 not found: ID does not exist"
Jul 08 20:02:18.979280 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979244    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-registry-certificates\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-installation-pull-secrets\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979308    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjzcj\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-kube-api-access-jjzcj\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979368    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979390    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-image-registry-private-configuration\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-bound-sa-token\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979461    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-trusted-ca\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.979795 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.979486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0af205fc-e910-4446-8bf0-a82aac21b662-ca-trust-extracted\") pod \"0af205fc-e910-4446-8bf0-a82aac21b662\" (UID: \"0af205fc-e910-4446-8bf0-a82aac21b662\") "
Jul 08 20:02:18.980136 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.980104    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 20:02:18.980223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.980147    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 20:02:18.981858 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.981807    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:02:18.982017 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.981993    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:02:18.982102 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.982088    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:02:18.982162 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.982107    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-kube-api-access-jjzcj" (OuterVolumeSpecName: "kube-api-access-jjzcj") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "kube-api-access-jjzcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:02:18.982302 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.982276    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:02:18.988589 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:18.988564    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0af205fc-e910-4446-8bf0-a82aac21b662-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0af205fc-e910-4446-8bf0-a82aac21b662" (UID: "0af205fc-e910-4446-8bf0-a82aac21b662"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:02:19.080851 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080816    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-registry-certificates\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.080851 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080850    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-installation-pull-secrets\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.081050 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080859    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjzcj\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-kube-api-access-jjzcj\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.081050 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080869    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-registry-tls\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.081050 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080880    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0af205fc-e910-4446-8bf0-a82aac21b662-image-registry-private-configuration\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.081050 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080888    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0af205fc-e910-4446-8bf0-a82aac21b662-bound-sa-token\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.081050 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080896    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0af205fc-e910-4446-8bf0-a82aac21b662-trusted-ca\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.081050 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.080904    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0af205fc-e910-4446-8bf0-a82aac21b662-ca-trust-extracted\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:02:19.184779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.184744    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78d9c465fd-vzs6l"]
Jul 08 20:02:19.186905 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:19.186882    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78d9c465fd-vzs6l"]
Jul 08 20:02:20.315790 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:02:20.315755    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0af205fc-e910-4446-8bf0-a82aac21b662" path="/var/lib/kubelet/pods/0af205fc-e910-4446-8bf0-a82aac21b662/volumes"
Jul 08 20:04:54.213184 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:04:54.213157    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 20:05:58.698186 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.698085    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bx8kl"]
Jul 08 20:05:58.698686 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.698646    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0af205fc-e910-4446-8bf0-a82aac21b662" containerName="registry"
Jul 08 20:05:58.698686 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.698665    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0af205fc-e910-4446-8bf0-a82aac21b662" containerName="registry"
Jul 08 20:05:58.698823 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.698807    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0af205fc-e910-4446-8bf0-a82aac21b662" containerName="registry"
Jul 08 20:05:58.702068 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.702046    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:58.704784 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.704758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 20:05:58.704903 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.704811    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 20:05:58.706058 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.706039    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-76f69\""
Jul 08 20:05:58.723271 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.723237    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bx8kl"]
Jul 08 20:05:58.814328 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.814293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lpv4\" (UniqueName: \"kubernetes.io/projected/07faaffd-b8ec-40bc-804f-f24d14331b44-kube-api-access-6lpv4\") pod \"cert-manager-55b4d954d5-bx8kl\" (UID: \"07faaffd-b8ec-40bc-804f-f24d14331b44\") " pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:58.814541 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.814350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07faaffd-b8ec-40bc-804f-f24d14331b44-bound-sa-token\") pod \"cert-manager-55b4d954d5-bx8kl\" (UID: \"07faaffd-b8ec-40bc-804f-f24d14331b44\") " pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:58.915623 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.915582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lpv4\" (UniqueName: \"kubernetes.io/projected/07faaffd-b8ec-40bc-804f-f24d14331b44-kube-api-access-6lpv4\") pod \"cert-manager-55b4d954d5-bx8kl\" (UID: \"07faaffd-b8ec-40bc-804f-f24d14331b44\") " pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:58.915623 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.915622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07faaffd-b8ec-40bc-804f-f24d14331b44-bound-sa-token\") pod \"cert-manager-55b4d954d5-bx8kl\" (UID: \"07faaffd-b8ec-40bc-804f-f24d14331b44\") " pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:58.941491 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.941465    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lpv4\" (UniqueName: \"kubernetes.io/projected/07faaffd-b8ec-40bc-804f-f24d14331b44-kube-api-access-6lpv4\") pod \"cert-manager-55b4d954d5-bx8kl\" (UID: \"07faaffd-b8ec-40bc-804f-f24d14331b44\") " pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:58.942448 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:58.942431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07faaffd-b8ec-40bc-804f-f24d14331b44-bound-sa-token\") pod \"cert-manager-55b4d954d5-bx8kl\" (UID: \"07faaffd-b8ec-40bc-804f-f24d14331b44\") " pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:59.010603 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:59.010522    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-bx8kl"
Jul 08 20:05:59.155219 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:59.155188    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-bx8kl"]
Jul 08 20:05:59.158568 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:05:59.158538    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07faaffd_b8ec_40bc_804f_f24d14331b44.slice/crio-bd00f485cd2f840928f1caf0bc54987e31676243e50226842682e90ae50ec47e WatchSource:0}: Error finding container bd00f485cd2f840928f1caf0bc54987e31676243e50226842682e90ae50ec47e: Status 404 returned error can't find the container with id bd00f485cd2f840928f1caf0bc54987e31676243e50226842682e90ae50ec47e
Jul 08 20:05:59.160483 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:59.160463    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 20:05:59.600487 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:05:59.600445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bx8kl" event={"ID":"07faaffd-b8ec-40bc-804f-f24d14331b44","Type":"ContainerStarted","Data":"bd00f485cd2f840928f1caf0bc54987e31676243e50226842682e90ae50ec47e"}
Jul 08 20:06:02.614506 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:02.614463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-bx8kl" event={"ID":"07faaffd-b8ec-40bc-804f-f24d14331b44","Type":"ContainerStarted","Data":"cecd4041aca51be866b659332727945079a62c90c97223ea428199063e460a40"}
Jul 08 20:06:02.638223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:02.638169    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-bx8kl" podStartSLOduration=1.5421122 podStartE2EDuration="4.638149883s" totalImagesPullingTime="3.096037683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:02.636954086 +0000 UTC m=+368.847960713" watchObservedRunningTime="2026-07-08 20:06:02.638149883 +0000 UTC m=+368.849156509"
Jul 08 20:06:21.753119 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.753079    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"]
Jul 08 20:06:21.757531 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.757512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.761463 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.761441    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 20:06:21.761597 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.761555    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 20:06:21.764523 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.764501    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 20:06:21.764662 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.764645    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 20:06:21.764733 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.764662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dh5bd\""
Jul 08 20:06:21.788194 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.788162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"]
Jul 08 20:06:21.884860 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.884814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.884860 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.884857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-webhook-cert\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.885087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.884878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-manifests\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.885087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.884954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r7wh\" (UniqueName: \"kubernetes.io/projected/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-kube-api-access-9r7wh\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.885087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.885010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-tmp\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.986207 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.986175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-webhook-cert\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.986207 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.986212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-manifests\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.986449 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.986235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r7wh\" (UniqueName: \"kubernetes.io/projected/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-kube-api-access-9r7wh\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.986449 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.986277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-tmp\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.986449 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.986345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.986679 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.986659    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-manifests\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.988628 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.988605    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-tmp\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.988753 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.988723    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-webhook-cert\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.988839 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.988819    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:21.999534 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:21.999499    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r7wh\" (UniqueName: \"kubernetes.io/projected/2e3dfdfb-4cd6-4069-ab1b-433f1916ba65-kube-api-access-9r7wh\") pod \"opendatahub-operator-controller-manager-67959458dc-fbfbs\" (UID: \"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65\") " pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:22.067807 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:22.067778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:22.221457 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:22.221434    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"]
Jul 08 20:06:22.222607 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:22.222581    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3dfdfb_4cd6_4069_ab1b_433f1916ba65.slice/crio-5f7d2924ec953ebeeeba5ebcdd8f10208020cb155e6ac3abdfaa32df233f8bf8 WatchSource:0}: Error finding container 5f7d2924ec953ebeeeba5ebcdd8f10208020cb155e6ac3abdfaa32df233f8bf8: Status 404 returned error can't find the container with id 5f7d2924ec953ebeeeba5ebcdd8f10208020cb155e6ac3abdfaa32df233f8bf8
Jul 08 20:06:22.684731 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:22.684692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs" event={"ID":"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65","Type":"ContainerStarted","Data":"5f7d2924ec953ebeeeba5ebcdd8f10208020cb155e6ac3abdfaa32df233f8bf8"}
Jul 08 20:06:25.696839 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:25.696750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs" event={"ID":"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65","Type":"ContainerStarted","Data":"ef981776e9fa32d92bc654c20203fef57437dadd2072b92b72342a74e1bdc1d0"}
Jul 08 20:06:26.702262 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:26.702175    2582 generic.go:356] "Generic (PLEG): container finished" podID="2e3dfdfb-4cd6-4069-ab1b-433f1916ba65" containerID="ef981776e9fa32d92bc654c20203fef57437dadd2072b92b72342a74e1bdc1d0" exitCode=0
Jul 08 20:06:26.702262 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:26.702241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs" event={"ID":"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65","Type":"ContainerDied","Data":"ef981776e9fa32d92bc654c20203fef57437dadd2072b92b72342a74e1bdc1d0"}
Jul 08 20:06:27.707645 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:27.707601    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs" event={"ID":"2e3dfdfb-4cd6-4069-ab1b-433f1916ba65","Type":"ContainerStarted","Data":"ec28d7c53aaf313386e70d027adfcb6a7b2d58ccf1b56f4d138a84d727b1ca49"}
Jul 08 20:06:27.708010 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:27.707725    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:27.735921 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:27.735866    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs" podStartSLOduration=2.136194555 podStartE2EDuration="6.735850171s" totalImagesPullingTime="3.571147206s" totalInitContainerRuntime="1.02850841s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:27.734903281 +0000 UTC m=+393.945909907" watchObservedRunningTime="2026-07-08 20:06:27.735850171 +0000 UTC m=+393.946856797"
Jul 08 20:06:38.713729 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:38.713696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67959458dc-fbfbs"
Jul 08 20:06:42.185543 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.185508    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"]
Jul 08 20:06:42.193915 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.193888    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.200571 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.200547    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 20:06:42.201276 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.201260    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 20:06:42.201946 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.201931    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 20:06:42.202422 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.202405    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 20:06:42.223567 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.223543    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"]
Jul 08 20:06:42.238737 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.238703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbldp\" (UniqueName: \"kubernetes.io/projected/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-kube-api-access-wbldp\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.238882 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.238750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-tmp\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.238882 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.238773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-tls-certs\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.340130 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.340091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-tls-certs\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.340280 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.340172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbldp\" (UniqueName: \"kubernetes.io/projected/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-kube-api-access-wbldp\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.340280 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.340204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-tmp\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.342464 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.342435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-tmp\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.342621 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.342606    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-tls-certs\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.369987 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.369951    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbldp\" (UniqueName: \"kubernetes.io/projected/cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b-kube-api-access-wbldp\") pod \"kube-auth-proxy-789db8bf69-dhp7g\" (UID: \"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b\") " pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.431072 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.431041    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vdcbj"]
Jul 08 20:06:42.434473 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.434445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.440832 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.440745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9zz8\" (UniqueName: \"kubernetes.io/projected/b6c60359-3796-449a-ac37-67f03fa68206-kube-api-access-p9zz8\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.440957 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.440873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.441079 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.441060    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 20:06:42.441157 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:42.441094    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"odh-model-controller-7998c67dc4-vdcbj\" is forbidden: User \"system:node:ip-10-0-136-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-70.ec2.internal' and this object" podUID="b6c60359-3796-449a-ac37-67f03fa68206" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.441483 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:42.441449    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-dockercfg-tqh4s\" is forbidden: User \"system:node:ip-10-0-136-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tqh4s\"" type="*v1.Secret"
Jul 08 20:06:42.467752 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.467717    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vdcbj"]
Jul 08 20:06:42.503305 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.503274    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"
Jul 08 20:06:42.541954 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.541917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.542156 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.542052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9zz8\" (UniqueName: \"kubernetes.io/projected/b6c60359-3796-449a-ac37-67f03fa68206-kube-api-access-p9zz8\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.542502 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:42.542481    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 20:06:42.542595 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:42.542546    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert podName:b6c60359-3796-449a-ac37-67f03fa68206 nodeName:}" failed. No retries permitted until 2026-07-08 20:06:43.042527567 +0000 UTC m=+409.253534172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert") pod "odh-model-controller-7998c67dc4-vdcbj" (UID: "b6c60359-3796-449a-ac37-67f03fa68206") : secret "odh-model-controller-webhook-cert" not found
Jul 08 20:06:42.567904 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.567868    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9zz8\" (UniqueName: \"kubernetes.io/projected/b6c60359-3796-449a-ac37-67f03fa68206-kube-api-access-p9zz8\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:42.678796 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.678717    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g"]
Jul 08 20:06:42.682404 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:42.682375    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabb46fd_ead9_4d76_8beb_ed4c65a5ea7b.slice/crio-73c1094a85213bea1c38dcfcb332205a062ed60febf0b8b3dbacbf74cbcde515 WatchSource:0}: Error finding container 73c1094a85213bea1c38dcfcb332205a062ed60febf0b8b3dbacbf74cbcde515: Status 404 returned error can't find the container with id 73c1094a85213bea1c38dcfcb332205a062ed60febf0b8b3dbacbf74cbcde515
Jul 08 20:06:42.761780 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:42.761694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g" event={"ID":"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b","Type":"ContainerStarted","Data":"73c1094a85213bea1c38dcfcb332205a062ed60febf0b8b3dbacbf74cbcde515"}
Jul 08 20:06:43.046217 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.046120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:43.046433 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:43.046301    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 08 20:06:43.046433 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:43.046396    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert podName:b6c60359-3796-449a-ac37-67f03fa68206 nodeName:}" failed. No retries permitted until 2026-07-08 20:06:44.046374568 +0000 UTC m=+410.257381175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert") pod "odh-model-controller-7998c67dc4-vdcbj" (UID: "b6c60359-3796-449a-ac37-67f03fa68206") : secret "odh-model-controller-webhook-cert" not found
Jul 08 20:06:43.457162 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.457122    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zs8mg"]
Jul 08 20:06:43.461554 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.461534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.464533 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.464509    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-xp6dk\""
Jul 08 20:06:43.465042 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.465027    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 20:06:43.487173 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.487116    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zs8mg"]
Jul 08 20:06:43.550306 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.550272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd37a585-0296-40da-9982-9aae09a476bc-tls-certs\") pod \"model-serving-api-54d89bd5fc-zs8mg\" (UID: \"cd37a585-0296-40da-9982-9aae09a476bc\") " pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.550493 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.550401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfvv\" (UniqueName: \"kubernetes.io/projected/cd37a585-0296-40da-9982-9aae09a476bc-kube-api-access-sgfvv\") pod \"model-serving-api-54d89bd5fc-zs8mg\" (UID: \"cd37a585-0296-40da-9982-9aae09a476bc\") " pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.651421 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.651382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfvv\" (UniqueName: \"kubernetes.io/projected/cd37a585-0296-40da-9982-9aae09a476bc-kube-api-access-sgfvv\") pod \"model-serving-api-54d89bd5fc-zs8mg\" (UID: \"cd37a585-0296-40da-9982-9aae09a476bc\") " pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.651596 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.651436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd37a585-0296-40da-9982-9aae09a476bc-tls-certs\") pod \"model-serving-api-54d89bd5fc-zs8mg\" (UID: \"cd37a585-0296-40da-9982-9aae09a476bc\") " pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.653832 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.653803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd37a585-0296-40da-9982-9aae09a476bc-tls-certs\") pod \"model-serving-api-54d89bd5fc-zs8mg\" (UID: \"cd37a585-0296-40da-9982-9aae09a476bc\") " pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.684764 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.684735    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfvv\" (UniqueName: \"kubernetes.io/projected/cd37a585-0296-40da-9982-9aae09a476bc-kube-api-access-sgfvv\") pod \"model-serving-api-54d89bd5fc-zs8mg\" (UID: \"cd37a585-0296-40da-9982-9aae09a476bc\") " pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.772597 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.772510    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:43.826825 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.826796    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tqh4s\""
Jul 08 20:06:43.955445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:43.955410    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zs8mg"]
Jul 08 20:06:43.963665 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:43.963638    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd37a585_0296_40da_9982_9aae09a476bc.slice/crio-ce76dee824231b79b7fbddbd51d9fa1197cb3cf70ede07eb52c691ead09f9e4c WatchSource:0}: Error finding container ce76dee824231b79b7fbddbd51d9fa1197cb3cf70ede07eb52c691ead09f9e4c: Status 404 returned error can't find the container with id ce76dee824231b79b7fbddbd51d9fa1197cb3cf70ede07eb52c691ead09f9e4c
Jul 08 20:06:44.054647 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.054554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:44.057481 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.057453    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c60359-3796-449a-ac37-67f03fa68206-cert\") pod \"odh-model-controller-7998c67dc4-vdcbj\" (UID: \"b6c60359-3796-449a-ac37-67f03fa68206\") " pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:44.246553 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.246517    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:44.398892 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.398859    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vdcbj"]
Jul 08 20:06:44.402999 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:44.402974    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c60359_3796_449a_ac37_67f03fa68206.slice/crio-0981b2fc5ef8c29c415fdd5275a34b300436a8ba418065e485d93b693d459b4f WatchSource:0}: Error finding container 0981b2fc5ef8c29c415fdd5275a34b300436a8ba418065e485d93b693d459b4f: Status 404 returned error can't find the container with id 0981b2fc5ef8c29c415fdd5275a34b300436a8ba418065e485d93b693d459b4f
Jul 08 20:06:44.655866 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.655783    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"]
Jul 08 20:06:44.660240 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.660223    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.663489 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.663466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 20:06:44.663752 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.663736    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 20:06:44.664019 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.664002    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 20:06:44.664019 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.664012    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6z75w\""
Jul 08 20:06:44.664842 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.664830    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 20:06:44.690236 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.689926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"]
Jul 08 20:06:44.760935 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.760889    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-istio-token\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.760935 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.760941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.761161 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.761000    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52cm8\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-kube-api-access-52cm8\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.761161 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.761047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a176237-f992-46fc-aab8-c33684a0171e-local-certs\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.761161 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.761084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-cacerts\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.761161 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.761116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.761161 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.761143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.770409 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.770365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg" event={"ID":"cd37a585-0296-40da-9982-9aae09a476bc","Type":"ContainerStarted","Data":"ce76dee824231b79b7fbddbd51d9fa1197cb3cf70ede07eb52c691ead09f9e4c"}
Jul 08 20:06:44.771763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.771729    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj" event={"ID":"b6c60359-3796-449a-ac37-67f03fa68206","Type":"ContainerStarted","Data":"0981b2fc5ef8c29c415fdd5275a34b300436a8ba418065e485d93b693d459b4f"}
Jul 08 20:06:44.862146 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-istio-token\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.862146 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.862432 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52cm8\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-kube-api-access-52cm8\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.862432 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a176237-f992-46fc-aab8-c33684a0171e-local-certs\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.862432 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-cacerts\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.862432 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.862432 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.862285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.863163 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.863137    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.865345 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.865253    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.865345 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.865272    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a176237-f992-46fc-aab8-c33684a0171e-local-certs\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.865582 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.865463    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.865582 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.865495    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-cacerts\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.874587 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.874519    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-istio-token\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.875436 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.875412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52cm8\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-kube-api-access-52cm8\") pod \"istiod-openshift-gateway-7574459656-fp4tk\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:44.970561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:44.970472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:45.120297 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:45.120208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"]
Jul 08 20:06:45.123561 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:45.123527    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a176237_f992_46fc_aab8_c33684a0171e.slice/crio-1ac256b75a41c2135f052bbb3f07ac0e3620b74ba4901515e69c825602c4e290 WatchSource:0}: Error finding container 1ac256b75a41c2135f052bbb3f07ac0e3620b74ba4901515e69c825602c4e290: Status 404 returned error can't find the container with id 1ac256b75a41c2135f052bbb3f07ac0e3620b74ba4901515e69c825602c4e290
Jul 08 20:06:45.778404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:45.778351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" event={"ID":"7a176237-f992-46fc-aab8-c33684a0171e","Type":"ContainerStarted","Data":"1ac256b75a41c2135f052bbb3f07ac0e3620b74ba4901515e69c825602c4e290"}
Jul 08 20:06:49.208220 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.208185    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:06:49.208518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.208251    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:06:49.797180 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.797135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g" event={"ID":"cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b","Type":"ContainerStarted","Data":"5b63ff6758aafd6143c98e611ec3208fe2296b56a08df52de37b515480bc053c"}
Jul 08 20:06:49.798746 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.798720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj" event={"ID":"b6c60359-3796-449a-ac37-67f03fa68206","Type":"ContainerStarted","Data":"b353aa28bf527f46d8c5c9140e334e06836974eab43ee7dbf18afe002042114f"}
Jul 08 20:06:49.798901 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.798810    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:06:49.800201 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.800174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" event={"ID":"7a176237-f992-46fc-aab8-c33684a0171e","Type":"ContainerStarted","Data":"200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2"}
Jul 08 20:06:49.800349 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.800234    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:49.801647 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.801617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg" event={"ID":"cd37a585-0296-40da-9982-9aae09a476bc","Type":"ContainerStarted","Data":"a4e9ee31d915effe8a106b55f40e245fa7d049d1fc949becc5ff090c3d4eda52"}
Jul 08 20:06:49.801749 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.801737    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:06:49.832661 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.832606    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-789db8bf69-dhp7g" podStartSLOduration=1.38232895 podStartE2EDuration="7.832588757s" totalImagesPullingTime="6.450259807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:49.832265589 +0000 UTC m=+416.043272215" watchObservedRunningTime="2026-07-08 20:06:49.832588757 +0000 UTC m=+416.043595382"
Jul 08 20:06:49.873813 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.870558    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg" podStartSLOduration=1.6410821599999998 podStartE2EDuration="6.870530854s" totalImagesPullingTime="5.229448694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:49.86779215 +0000 UTC m=+416.078798777" watchObservedRunningTime="2026-07-08 20:06:49.870530854 +0000 UTC m=+416.081537474"
Jul 08 20:06:49.923063 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.923006    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" podStartSLOduration=1.84147674 podStartE2EDuration="5.922989858s" totalImagesPullingTime="4.081513118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:49.921727319 +0000 UTC m=+416.132733946" watchObservedRunningTime="2026-07-08 20:06:49.922989858 +0000 UTC m=+416.133996484"
Jul 08 20:06:49.958145 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:49.958087    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj" podStartSLOduration=3.153916292 podStartE2EDuration="7.958070539s" totalImagesPullingTime="4.804154247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:49.957691895 +0000 UTC m=+416.168698522" watchObservedRunningTime="2026-07-08 20:06:49.958070539 +0000 UTC m=+416.169077164"
Jul 08 20:06:50.807866 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:50.807833    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-fp4tk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 20:06:50.808300 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:50.807892    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" podUID="7a176237-f992-46fc-aab8-c33684a0171e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 20:06:51.634397 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.634359    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"]
Jul 08 20:06:51.637878 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.637852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.644115 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.644090    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ctln9\""
Jul 08 20:06:51.661507 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.661476    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"]
Jul 08 20:06:51.720216 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720411 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720411 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720411 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720424    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6p7p\" (UniqueName: \"kubernetes.io/projected/4492635f-c6ff-4351-b0ed-99caa488d8bc-kube-api-access-c6p7p\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4492635f-c6ff-4351-b0ed-99caa488d8bc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.720604 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.720569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.821817 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.821777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.821828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6p7p\" (UniqueName: \"kubernetes.io/projected/4492635f-c6ff-4351-b0ed-99caa488d8bc-kube-api-access-c6p7p\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.821868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4492635f-c6ff-4351-b0ed-99caa488d8bc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.821894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.821919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822307 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822344    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822348    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822461    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.822754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822727    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.823004 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.822985    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4492635f-c6ff-4351-b0ed-99caa488d8bc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.824763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.824739    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.824859 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.824813    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.837029 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.836987    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6p7p\" (UniqueName: \"kubernetes.io/projected/4492635f-c6ff-4351-b0ed-99caa488d8bc-kube-api-access-c6p7p\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.838974 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.838950    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4492635f-c6ff-4351-b0ed-99caa488d8bc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678lh7zg\" (UID: \"4492635f-c6ff-4351-b0ed-99caa488d8bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:51.948818 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:51.948731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:52.164563 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:52.164528    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"]
Jul 08 20:06:52.173095 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:52.173067    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4492635f_c6ff_4351_b0ed_99caa488d8bc.slice/crio-1a06bebaa93c1230316ae04fb443772a351d3bef252843cf39ad599badad4fdc WatchSource:0}: Error finding container 1a06bebaa93c1230316ae04fb443772a351d3bef252843cf39ad599badad4fdc: Status 404 returned error can't find the container with id 1a06bebaa93c1230316ae04fb443772a351d3bef252843cf39ad599badad4fdc
Jul 08 20:06:52.815712 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:52.815678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg" event={"ID":"4492635f-c6ff-4351-b0ed-99caa488d8bc","Type":"ContainerStarted","Data":"1a06bebaa93c1230316ae04fb443772a351d3bef252843cf39ad599badad4fdc"}
Jul 08 20:06:53.807617 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:53.807576    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:55.112311 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.112272    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:06:55.112632 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.112366    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:06:55.112632 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.112397    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:06:55.132377 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.132344    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"]
Jul 08 20:06:55.137179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.137157    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.141270 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.141247    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-prj2z\""
Jul 08 20:06:55.143060 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.143044    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 20:06:55.145332 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.145290    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"]
Jul 08 20:06:55.148953 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.148929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.154214 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.154140    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 20:06:55.155035 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.155018    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-c8qvz\""
Jul 08 20:06:55.183299 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.183273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"]
Jul 08 20:06:55.212639 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.212604    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"]
Jul 08 20:06:55.251076 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.251033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a2c68d-b4ec-4687-bab1-711a55febffb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rhlnk\" (UID: \"94a2c68d-b4ec-4687-bab1-711a55febffb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.251260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.251126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djnx\" (UniqueName: \"kubernetes.io/projected/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-kube-api-access-2djnx\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.251260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.251172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.251260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.251216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnq94\" (UniqueName: \"kubernetes.io/projected/94a2c68d-b4ec-4687-bab1-711a55febffb-kube-api-access-xnq94\") pod \"kserve-controller-manager-d6f4b65b8-rhlnk\" (UID: \"94a2c68d-b4ec-4687-bab1-711a55febffb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.352223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.352182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnq94\" (UniqueName: \"kubernetes.io/projected/94a2c68d-b4ec-4687-bab1-711a55febffb-kube-api-access-xnq94\") pod \"kserve-controller-manager-d6f4b65b8-rhlnk\" (UID: \"94a2c68d-b4ec-4687-bab1-711a55febffb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.352430 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.352237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a2c68d-b4ec-4687-bab1-711a55febffb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rhlnk\" (UID: \"94a2c68d-b4ec-4687-bab1-711a55febffb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.352430 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.352272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djnx\" (UniqueName: \"kubernetes.io/projected/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-kube-api-access-2djnx\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.352430 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.352293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.352430 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:55.352418    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 08 20:06:55.352640 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:55.352479    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-cert podName:67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d nodeName:}" failed. No retries permitted until 2026-07-08 20:06:55.852459193 +0000 UTC m=+422.063465799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-cert") pod "llmisvc-controller-manager-777c6bd7d5-4lr5z" (UID: "67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d") : secret "llmisvc-webhook-server-cert" not found
Jul 08 20:06:55.354751 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.354728    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a2c68d-b4ec-4687-bab1-711a55febffb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rhlnk\" (UID: \"94a2c68d-b4ec-4687-bab1-711a55febffb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.366299 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.366230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djnx\" (UniqueName: \"kubernetes.io/projected/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-kube-api-access-2djnx\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.366299 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.366276    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnq94\" (UniqueName: \"kubernetes.io/projected/94a2c68d-b4ec-4687-bab1-711a55febffb-kube-api-access-xnq94\") pod \"kserve-controller-manager-d6f4b65b8-rhlnk\" (UID: \"94a2c68d-b4ec-4687-bab1-711a55febffb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.458327 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.458279    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:06:55.663109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.663026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"]
Jul 08 20:06:55.668680 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:55.668653    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a2c68d_b4ec_4687_bab1_711a55febffb.slice/crio-0a5f455090f3e8e39783524313c15fb73bcdc0d8002a88d7f4c627de29800839 WatchSource:0}: Error finding container 0a5f455090f3e8e39783524313c15fb73bcdc0d8002a88d7f4c627de29800839: Status 404 returned error can't find the container with id 0a5f455090f3e8e39783524313c15fb73bcdc0d8002a88d7f4c627de29800839
Jul 08 20:06:55.831033 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.830996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg" event={"ID":"4492635f-c6ff-4351-b0ed-99caa488d8bc","Type":"ContainerStarted","Data":"5159049e24a09a36b3beb0ca5f60de5e474d0030ddf14cf6a38ecbe0d5d27d28"}
Jul 08 20:06:55.832239 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.832214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk" event={"ID":"94a2c68d-b4ec-4687-bab1-711a55febffb","Type":"ContainerStarted","Data":"0a5f455090f3e8e39783524313c15fb73bcdc0d8002a88d7f4c627de29800839"}
Jul 08 20:06:55.856904 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.856869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.859259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.859241    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4lr5z\" (UID: \"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:55.893076 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.893023    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg" podStartSLOduration=1.956139152 podStartE2EDuration="4.893006281s" totalImagesPullingTime="2.936867129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:06:55.890405572 +0000 UTC m=+422.101412199" watchObservedRunningTime="2026-07-08 20:06:55.893006281 +0000 UTC m=+422.104012906"
Jul 08 20:06:55.949844 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:55.949749    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:56.077638 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:56.077602    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:06:56.231410 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:56.231331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"]
Jul 08 20:06:56.234245 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:06:56.234213    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67fbc7ab_b7cb_4b40_bbbf_c2697ffaa93d.slice/crio-2aca2a9c1e54e1de2c8eb5deeaf7b9e18f54a35866726b6c227d794484da0e5b WatchSource:0}: Error finding container 2aca2a9c1e54e1de2c8eb5deeaf7b9e18f54a35866726b6c227d794484da0e5b: Status 404 returned error can't find the container with id 2aca2a9c1e54e1de2c8eb5deeaf7b9e18f54a35866726b6c227d794484da0e5b
Jul 08 20:06:56.837615 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:56.837574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z" event={"ID":"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d","Type":"ContainerStarted","Data":"2aca2a9c1e54e1de2c8eb5deeaf7b9e18f54a35866726b6c227d794484da0e5b"}
Jul 08 20:06:56.954341 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:56.954297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:57.843111 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:57.843039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:57.844104 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:57.844076    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678lh7zg"
Jul 08 20:06:58.883577 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:58.883537    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"]
Jul 08 20:06:58.883950 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:58.883730    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" podUID="7a176237-f992-46fc-aab8-c33684a0171e" containerName="discovery" containerID="cri-o://200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2" gracePeriod=30
Jul 08 20:06:59.231423 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.231397    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:59.292056 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52cm8\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-kube-api-access-52cm8\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.292242 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292070    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-kubeconfig\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.292242 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-istio-token\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.293450 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a176237-f992-46fc-aab8-c33684a0171e-local-certs\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.293450 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292353    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-cacerts\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.293450 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-dns-cert\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.293450 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.292439    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-ca-configmap\") pod \"7a176237-f992-46fc-aab8-c33684a0171e\" (UID: \"7a176237-f992-46fc-aab8-c33684a0171e\") "
Jul 08 20:06:59.293450 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.293282    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 20:06:59.295526 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.295480    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:06:59.295526 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.295501    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-kube-api-access-52cm8" (OuterVolumeSpecName: "kube-api-access-52cm8") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "kube-api-access-52cm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:06:59.295526 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.295511    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a176237-f992-46fc-aab8-c33684a0171e-local-certs" (OuterVolumeSpecName: "local-certs") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:06:59.295761 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.295673    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:06:59.295930 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.295899    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-cacerts" (OuterVolumeSpecName: "cacerts") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:06:59.296114 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.296091    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7a176237-f992-46fc-aab8-c33684a0171e" (UID: "7a176237-f992-46fc-aab8-c33684a0171e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:06:59.393087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393040    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52cm8\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-kube-api-access-52cm8\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.393087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393086    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-kubeconfig\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.393087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393101    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a176237-f992-46fc-aab8-c33684a0171e-istio-token\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.393388 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393110    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a176237-f992-46fc-aab8-c33684a0171e-local-certs\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.393388 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393119    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-cacerts\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.393388 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393126    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-dns-cert\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.393388 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.393138    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7a176237-f992-46fc-aab8-c33684a0171e-istio-csr-ca-configmap\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:06:59.854155 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.854123    2582 generic.go:356] "Generic (PLEG): container finished" podID="7a176237-f992-46fc-aab8-c33684a0171e" containerID="200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2" exitCode=0
Jul 08 20:06:59.854275 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.854169    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"
Jul 08 20:06:59.854275 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.854206    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" event={"ID":"7a176237-f992-46fc-aab8-c33684a0171e","Type":"ContainerDied","Data":"200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2"}
Jul 08 20:06:59.854275 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.854259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk" event={"ID":"7a176237-f992-46fc-aab8-c33684a0171e","Type":"ContainerDied","Data":"1ac256b75a41c2135f052bbb3f07ac0e3620b74ba4901515e69c825602c4e290"}
Jul 08 20:06:59.854405 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.854284    2582 scope.go:117] "RemoveContainer" containerID="200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2"
Jul 08 20:06:59.862572 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.862554    2582 scope.go:117] "RemoveContainer" containerID="200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2"
Jul 08 20:06:59.862826 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:06:59.862808    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2\": container with ID starting with 200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2 not found: ID does not exist" containerID="200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2"
Jul 08 20:06:59.862890 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.862840    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2"} err="failed to get container status \"200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2\": rpc error: code = NotFound desc = could not find container \"200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2\": container with ID starting with 200bc90f1e6f91c4a7c0560cb6a117a40463a03a64a51be0c00241b439443fa2 not found: ID does not exist"
Jul 08 20:06:59.881352 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.881297    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"]
Jul 08 20:06:59.887442 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:06:59.887413    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fp4tk"]
Jul 08 20:07:00.316861 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.316821    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a176237-f992-46fc-aab8-c33684a0171e" path="/var/lib/kubelet/pods/7a176237-f992-46fc-aab8-c33684a0171e/volumes"
Jul 08 20:07:00.808160 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.808129    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vdcbj"
Jul 08 20:07:00.811950 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.811925    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zs8mg"
Jul 08 20:07:00.862059 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.862017    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z" event={"ID":"67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d","Type":"ContainerStarted","Data":"14561d63854a442e2081af38d7f9b258b44f4fe7d4951f8b5f43e621ef826b7c"}
Jul 08 20:07:00.862232 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.862132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:07:00.863603 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.863570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk" event={"ID":"94a2c68d-b4ec-4687-bab1-711a55febffb","Type":"ContainerStarted","Data":"3efc027fca1a20491ada8001dfb0f9d1bb0606babd8ab6bb829b524b0b44f44f"}
Jul 08 20:07:00.863701 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.863621    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:07:00.900072 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.900018    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z" podStartSLOduration=1.956819506 podStartE2EDuration="5.900000023s" totalImagesPullingTime="3.943180517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:07:00.898478301 +0000 UTC m=+427.109484930" watchObservedRunningTime="2026-07-08 20:07:00.900000023 +0000 UTC m=+427.111006649"
Jul 08 20:07:00.927107 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:00.927051    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk" podStartSLOduration=1.7469702040000001 podStartE2EDuration="5.927027232s" totalImagesPullingTime="4.180057028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:07:00.925586983 +0000 UTC m=+427.136593610" watchObservedRunningTime="2026-07-08 20:07:00.927027232 +0000 UTC m=+427.138033861"
Jul 08 20:07:31.870027 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:31.869939    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4lr5z"
Jul 08 20:07:31.872967 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:31.872948    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rhlnk"
Jul 08 20:07:43.443871 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.443834    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rg8q7"]
Jul 08 20:07:43.444259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.444129    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a176237-f992-46fc-aab8-c33684a0171e" containerName="discovery"
Jul 08 20:07:43.444259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.444141    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a176237-f992-46fc-aab8-c33684a0171e" containerName="discovery"
Jul 08 20:07:43.444259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.444204    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a176237-f992-46fc-aab8-c33684a0171e" containerName="discovery"
Jul 08 20:07:43.453350 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.453299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:43.456792 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.456767    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 20:07:43.458108 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.458084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hfd6p\""
Jul 08 20:07:43.458280 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.458093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 20:07:43.460982 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.460958    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rg8q7"]
Jul 08 20:07:43.556589 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.556546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnf9\" (UniqueName: \"kubernetes.io/projected/a1f3272b-06f9-4870-acfe-a85d16eb61ee-kube-api-access-cfnf9\") pod \"kuadrant-operator-catalog-rg8q7\" (UID: \"a1f3272b-06f9-4870-acfe-a85d16eb61ee\") " pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:43.657104 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.657065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnf9\" (UniqueName: \"kubernetes.io/projected/a1f3272b-06f9-4870-acfe-a85d16eb61ee-kube-api-access-cfnf9\") pod \"kuadrant-operator-catalog-rg8q7\" (UID: \"a1f3272b-06f9-4870-acfe-a85d16eb61ee\") " pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:43.666260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.666225    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnf9\" (UniqueName: \"kubernetes.io/projected/a1f3272b-06f9-4870-acfe-a85d16eb61ee-kube-api-access-cfnf9\") pod \"kuadrant-operator-catalog-rg8q7\" (UID: \"a1f3272b-06f9-4870-acfe-a85d16eb61ee\") " pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:43.765629 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.765533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:43.904013 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:43.903989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rg8q7"]
Jul 08 20:07:43.906207 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:07:43.906172    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f3272b_06f9_4870_acfe_a85d16eb61ee.slice/crio-68a91aa6beb3d27798be8a567e49853869ec736f9607e6f1dbd6a277bbd42d11 WatchSource:0}: Error finding container 68a91aa6beb3d27798be8a567e49853869ec736f9607e6f1dbd6a277bbd42d11: Status 404 returned error can't find the container with id 68a91aa6beb3d27798be8a567e49853869ec736f9607e6f1dbd6a277bbd42d11
Jul 08 20:07:44.034769 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.034682    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rg8q7"]
Jul 08 20:07:44.055668 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.055633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7" event={"ID":"a1f3272b-06f9-4870-acfe-a85d16eb61ee","Type":"ContainerStarted","Data":"68a91aa6beb3d27798be8a567e49853869ec736f9607e6f1dbd6a277bbd42d11"}
Jul 08 20:07:44.063077 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.063050    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfjtg"]
Jul 08 20:07:44.067483 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.067466    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:44.076108 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.076078    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfjtg"]
Jul 08 20:07:44.262897 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.262855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvv5p\" (UniqueName: \"kubernetes.io/projected/41c7b885-0358-4231-a7be-866267ce55d8-kube-api-access-xvv5p\") pod \"kuadrant-operator-catalog-tfjtg\" (UID: \"41c7b885-0358-4231-a7be-866267ce55d8\") " pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:44.364283 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.364248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvv5p\" (UniqueName: \"kubernetes.io/projected/41c7b885-0358-4231-a7be-866267ce55d8-kube-api-access-xvv5p\") pod \"kuadrant-operator-catalog-tfjtg\" (UID: \"41c7b885-0358-4231-a7be-866267ce55d8\") " pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:44.378790 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.378757    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvv5p\" (UniqueName: \"kubernetes.io/projected/41c7b885-0358-4231-a7be-866267ce55d8-kube-api-access-xvv5p\") pod \"kuadrant-operator-catalog-tfjtg\" (UID: \"41c7b885-0358-4231-a7be-866267ce55d8\") " pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:44.677403 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.677310    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:44.888125 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:44.887820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfjtg"]
Jul 08 20:07:45.006871 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:07:45.006785    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c7b885_0358_4231_a7be_866267ce55d8.slice/crio-0789b3b0b3c7b752140baf74d1ff490ad7caf2d243faa603f8ed8b3089fc5598 WatchSource:0}: Error finding container 0789b3b0b3c7b752140baf74d1ff490ad7caf2d243faa603f8ed8b3089fc5598: Status 404 returned error can't find the container with id 0789b3b0b3c7b752140baf74d1ff490ad7caf2d243faa603f8ed8b3089fc5598
Jul 08 20:07:45.064471 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:45.064434    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg" event={"ID":"41c7b885-0358-4231-a7be-866267ce55d8","Type":"ContainerStarted","Data":"0789b3b0b3c7b752140baf74d1ff490ad7caf2d243faa603f8ed8b3089fc5598"}
Jul 08 20:07:47.075217 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.075176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg" event={"ID":"41c7b885-0358-4231-a7be-866267ce55d8","Type":"ContainerStarted","Data":"3e60e2e402ac03d964dc040fc0413d42ef0b1fad49ee9ba85c4e3df1737d437b"}
Jul 08 20:07:47.076591 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.076571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7" event={"ID":"a1f3272b-06f9-4870-acfe-a85d16eb61ee","Type":"ContainerStarted","Data":"9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8"}
Jul 08 20:07:47.076689 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.076648    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7" podUID="a1f3272b-06f9-4870-acfe-a85d16eb61ee" containerName="registry-server" containerID="cri-o://9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8" gracePeriod=2
Jul 08 20:07:47.101241 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.101194    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg" podStartSLOduration=2.041270932 podStartE2EDuration="3.101180402s" totalImagesPullingTime="1.05990947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:07:47.100208787 +0000 UTC m=+473.311215413" watchObservedRunningTime="2026-07-08 20:07:47.101180402 +0000 UTC m=+473.312187027"
Jul 08 20:07:47.129194 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.129134    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7" podStartSLOduration=1.968689957 podStartE2EDuration="4.129117054s" totalImagesPullingTime="2.160427097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:07:47.12815967 +0000 UTC m=+473.339166297" watchObservedRunningTime="2026-07-08 20:07:47.129117054 +0000 UTC m=+473.340123680"
Jul 08 20:07:47.314877 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.314849    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:47.385217 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.385126    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfnf9\" (UniqueName: \"kubernetes.io/projected/a1f3272b-06f9-4870-acfe-a85d16eb61ee-kube-api-access-cfnf9\") pod \"a1f3272b-06f9-4870-acfe-a85d16eb61ee\" (UID: \"a1f3272b-06f9-4870-acfe-a85d16eb61ee\") "
Jul 08 20:07:47.387325 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.387288    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f3272b-06f9-4870-acfe-a85d16eb61ee-kube-api-access-cfnf9" (OuterVolumeSpecName: "kube-api-access-cfnf9") pod "a1f3272b-06f9-4870-acfe-a85d16eb61ee" (UID: "a1f3272b-06f9-4870-acfe-a85d16eb61ee"). InnerVolumeSpecName "kube-api-access-cfnf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:07:47.485610 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:47.485572    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfnf9\" (UniqueName: \"kubernetes.io/projected/a1f3272b-06f9-4870-acfe-a85d16eb61ee-kube-api-access-cfnf9\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:07:48.083849 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.083816    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1f3272b-06f9-4870-acfe-a85d16eb61ee" containerID="9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8" exitCode=0
Jul 08 20:07:48.084285 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.083856    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7"
Jul 08 20:07:48.084285 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.083888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7" event={"ID":"a1f3272b-06f9-4870-acfe-a85d16eb61ee","Type":"ContainerDied","Data":"9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8"}
Jul 08 20:07:48.084285 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.083924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rg8q7" event={"ID":"a1f3272b-06f9-4870-acfe-a85d16eb61ee","Type":"ContainerDied","Data":"68a91aa6beb3d27798be8a567e49853869ec736f9607e6f1dbd6a277bbd42d11"}
Jul 08 20:07:48.084285 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.083943    2582 scope.go:117] "RemoveContainer" containerID="9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8"
Jul 08 20:07:48.092747 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.092725    2582 scope.go:117] "RemoveContainer" containerID="9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8"
Jul 08 20:07:48.092996 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:07:48.092975    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8\": container with ID starting with 9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8 not found: ID does not exist" containerID="9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8"
Jul 08 20:07:48.093061 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.093010    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8"} err="failed to get container status \"9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8\": rpc error: code = NotFound desc = could not find container \"9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8\": container with ID starting with 9858559001cd17f9b004147b71e2f0ada690be506e4031b79cab46aa44c4bbe8 not found: ID does not exist"
Jul 08 20:07:48.108894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.108867    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rg8q7"]
Jul 08 20:07:48.114046 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.114026    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rg8q7"]
Jul 08 20:07:48.316656 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:48.316620    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1f3272b-06f9-4870-acfe-a85d16eb61ee" path="/var/lib/kubelet/pods/a1f3272b-06f9-4870-acfe-a85d16eb61ee/volumes"
Jul 08 20:07:54.677814 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:54.677773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:54.678273 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:54.677847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:54.700282 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:54.700245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:07:55.137999 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:07:55.137954    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tfjtg"
Jul 08 20:08:18.379772 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.379736    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"]
Jul 08 20:08:18.380260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.380037    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f3272b-06f9-4870-acfe-a85d16eb61ee" containerName="registry-server"
Jul 08 20:08:18.380260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.380047    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f3272b-06f9-4870-acfe-a85d16eb61ee" containerName="registry-server"
Jul 08 20:08:18.380260 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.380107    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f3272b-06f9-4870-acfe-a85d16eb61ee" containerName="registry-server"
Jul 08 20:08:18.386867 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.386837    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.391873 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.391849    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hhfqt\""
Jul 08 20:08:18.404834 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.404805    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"]
Jul 08 20:08:18.438110 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.438074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d9f910-7d91-467c-aa26-82d27f519f6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.438271 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.438121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hh28\" (UniqueName: \"kubernetes.io/projected/94d9f910-7d91-467c-aa26-82d27f519f6b-kube-api-access-6hh28\") pod \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.539089 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.539035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d9f910-7d91-467c-aa26-82d27f519f6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.539258 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.539113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hh28\" (UniqueName: \"kubernetes.io/projected/94d9f910-7d91-467c-aa26-82d27f519f6b-kube-api-access-6hh28\") pod \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.539477 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.539457    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d9f910-7d91-467c-aa26-82d27f519f6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.553657 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.553623    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hh28\" (UniqueName: \"kubernetes.io/projected/94d9f910-7d91-467c-aa26-82d27f519f6b-kube-api-access-6hh28\") pod \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.697021 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.696937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:18.862681 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:18.862643    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"]
Jul 08 20:08:18.865354 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:08:18.865298    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d9f910_7d91_467c_aa26_82d27f519f6b.slice/crio-a194fcbd0f94586ce807c772a2334e76fc2b507546edbd4ba8e19deac3addde5 WatchSource:0}: Error finding container a194fcbd0f94586ce807c772a2334e76fc2b507546edbd4ba8e19deac3addde5: Status 404 returned error can't find the container with id a194fcbd0f94586ce807c772a2334e76fc2b507546edbd4ba8e19deac3addde5
Jul 08 20:08:19.212086 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:19.212049    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd" event={"ID":"94d9f910-7d91-467c-aa26-82d27f519f6b","Type":"ContainerStarted","Data":"a194fcbd0f94586ce807c772a2334e76fc2b507546edbd4ba8e19deac3addde5"}
Jul 08 20:08:20.275625 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.275590    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"]
Jul 08 20:08:20.282535 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.282512    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:20.286145 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.286126    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6fdbq\""
Jul 08 20:08:20.302752 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.302724    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"]
Jul 08 20:08:20.353443 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.353405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dmlk\" (UniqueName: \"kubernetes.io/projected/d0ed3a9b-9a61-4486-98ae-40510eed194a-kube-api-access-6dmlk\") pod \"limitador-operator-controller-manager-859d7b78bd-n7zsg\" (UID: \"d0ed3a9b-9a61-4486-98ae-40510eed194a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:20.454209 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.454170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dmlk\" (UniqueName: \"kubernetes.io/projected/d0ed3a9b-9a61-4486-98ae-40510eed194a-kube-api-access-6dmlk\") pod \"limitador-operator-controller-manager-859d7b78bd-n7zsg\" (UID: \"d0ed3a9b-9a61-4486-98ae-40510eed194a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:20.469608 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.469574    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dmlk\" (UniqueName: \"kubernetes.io/projected/d0ed3a9b-9a61-4486-98ae-40510eed194a-kube-api-access-6dmlk\") pod \"limitador-operator-controller-manager-859d7b78bd-n7zsg\" (UID: \"d0ed3a9b-9a61-4486-98ae-40510eed194a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:20.592696 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.592655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:20.741067 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:20.741027    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"]
Jul 08 20:08:20.744728 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:08:20.744700    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ed3a9b_9a61_4486_98ae_40510eed194a.slice/crio-658abc34f6f5cb5f1d893bc4e302083586d509508043a41655b03d589c11f3d6 WatchSource:0}: Error finding container 658abc34f6f5cb5f1d893bc4e302083586d509508043a41655b03d589c11f3d6: Status 404 returned error can't find the container with id 658abc34f6f5cb5f1d893bc4e302083586d509508043a41655b03d589c11f3d6
Jul 08 20:08:21.222218 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:21.222181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg" event={"ID":"d0ed3a9b-9a61-4486-98ae-40510eed194a","Type":"ContainerStarted","Data":"658abc34f6f5cb5f1d893bc4e302083586d509508043a41655b03d589c11f3d6"}
Jul 08 20:08:23.166602 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.166560    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"]
Jul 08 20:08:23.170593 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.170570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:23.174919 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.174894    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-srls4\""
Jul 08 20:08:23.186333 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.184841    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"]
Jul 08 20:08:23.277555 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.277513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6sgw\" (UniqueName: \"kubernetes.io/projected/436f8f51-2802-4187-9bb9-c266b3642fd8-kube-api-access-k6sgw\") pod \"authorino-operator-75cc8d5cb7-l8pck\" (UID: \"436f8f51-2802-4187-9bb9-c266b3642fd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:23.378778 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.378749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6sgw\" (UniqueName: \"kubernetes.io/projected/436f8f51-2802-4187-9bb9-c266b3642fd8-kube-api-access-k6sgw\") pod \"authorino-operator-75cc8d5cb7-l8pck\" (UID: \"436f8f51-2802-4187-9bb9-c266b3642fd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:23.388128 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.388097    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6sgw\" (UniqueName: \"kubernetes.io/projected/436f8f51-2802-4187-9bb9-c266b3642fd8-kube-api-access-k6sgw\") pod \"authorino-operator-75cc8d5cb7-l8pck\" (UID: \"436f8f51-2802-4187-9bb9-c266b3642fd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:23.490025 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.489925    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:23.662301 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:23.662267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"]
Jul 08 20:08:23.665231 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:08:23.665201    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436f8f51_2802_4187_9bb9_c266b3642fd8.slice/crio-960a2067f68f0fbfbeab93e2298568b54758ce94a0276cbfdd7fbb4afbf273cb WatchSource:0}: Error finding container 960a2067f68f0fbfbeab93e2298568b54758ce94a0276cbfdd7fbb4afbf273cb: Status 404 returned error can't find the container with id 960a2067f68f0fbfbeab93e2298568b54758ce94a0276cbfdd7fbb4afbf273cb
Jul 08 20:08:24.240207 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:24.240165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg" event={"ID":"d0ed3a9b-9a61-4486-98ae-40510eed194a","Type":"ContainerStarted","Data":"47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7"}
Jul 08 20:08:24.240684 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:24.240282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:24.241662 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:24.241627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck" event={"ID":"436f8f51-2802-4187-9bb9-c266b3642fd8","Type":"ContainerStarted","Data":"960a2067f68f0fbfbeab93e2298568b54758ce94a0276cbfdd7fbb4afbf273cb"}
Jul 08 20:08:24.267000 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:24.266942    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg" podStartSLOduration=1.708805007 podStartE2EDuration="4.266924334s" totalImagesPullingTime="2.558119327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:08:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:08:24.264003426 +0000 UTC m=+510.475010053" watchObservedRunningTime="2026-07-08 20:08:24.266924334 +0000 UTC m=+510.477930960"
Jul 08 20:08:27.257071 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:27.257031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd" event={"ID":"94d9f910-7d91-467c-aa26-82d27f519f6b","Type":"ContainerStarted","Data":"c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3"}
Jul 08 20:08:27.257560 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:27.257106    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:27.258425 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:27.258400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck" event={"ID":"436f8f51-2802-4187-9bb9-c266b3642fd8","Type":"ContainerStarted","Data":"3d980095b26c38adb4d61b911615daec6a5bff3c18ef273f7cae069472dd1265"}
Jul 08 20:08:27.258538 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:27.258521    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:27.287731 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:27.287681    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd" podStartSLOduration=1.5528627799999999 podStartE2EDuration="9.287665149s" totalImagesPullingTime="7.734802369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:08:27.28692223 +0000 UTC m=+513.497928855" watchObservedRunningTime="2026-07-08 20:08:27.287665149 +0000 UTC m=+513.498671775"
Jul 08 20:08:27.311105 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:27.310506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck" podStartSLOduration=1.3382087280000001 podStartE2EDuration="4.310488227s" totalImagesPullingTime="2.972279499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:08:27.308279348 +0000 UTC m=+513.519285973" watchObservedRunningTime="2026-07-08 20:08:27.310488227 +0000 UTC m=+513.521494854"
Jul 08 20:08:35.249480 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:35.249445    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:38.270561 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:38.270533    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:38.270945 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:38.270614    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l8pck"
Jul 08 20:08:40.238477 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.238437    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"]
Jul 08 20:08:40.238913 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.238616    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" containerName="manager" containerID="cri-o://c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3" gracePeriod=2
Jul 08 20:08:40.241481 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:40.241416    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" is forbidden: User \"system:node:ip-10-0-136-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-70.ec2.internal' and this object" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:40.247696 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.247655    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"]
Jul 08 20:08:40.273413 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.273378    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"]
Jul 08 20:08:40.273675 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.273649    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg" podUID="d0ed3a9b-9a61-4486-98ae-40510eed194a" containerName="manager" containerID="cri-o://47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7" gracePeriod=2
Jul 08 20:08:40.292910 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.292879    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"]
Jul 08 20:08:40.299717 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.299685    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"]
Jul 08 20:08:40.300027 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.300008    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ed3a9b-9a61-4486-98ae-40510eed194a" containerName="manager"
Jul 08 20:08:40.300027 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.300027    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ed3a9b-9a61-4486-98ae-40510eed194a" containerName="manager"
Jul 08 20:08:40.300176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.300039    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" containerName="manager"
Jul 08 20:08:40.300176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.300044    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" containerName="manager"
Jul 08 20:08:40.300176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.300119    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" containerName="manager"
Jul 08 20:08:40.300176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.300129    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ed3a9b-9a61-4486-98ae-40510eed194a" containerName="manager"
Jul 08 20:08:40.303105 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.303087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.307074 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:40.307044    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0ed3a9b-9a61-4486-98ae-40510eed194a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-n7zsg\": pods \"limitador-operator-controller-manager-859d7b78bd-n7zsg\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:40.313389 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:40.313352    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" is forbidden: User \"system:node:ip-10-0-136-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-70.ec2.internal' and this object" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:40.316437 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:40.316394    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n7zsg\" is forbidden: User \"system:node:ip-10-0-136-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-70.ec2.internal' and this object" podUID="d0ed3a9b-9a61-4486-98ae-40510eed194a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:40.318948 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.318922    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"]
Jul 08 20:08:40.319072 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:40.318996    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-smvdd\" is forbidden: User \"system:node:ip-10-0-136-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-70.ec2.internal' and this object" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:40.323289 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.323266    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:40.324924 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.324899    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"]
Jul 08 20:08:40.333185 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.333156    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"]
Jul 08 20:08:40.425947 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.425901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8650a9d-1d68-483a-92d9-f5401c77e681-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n6pbk\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.426118 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.425973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ws9n\" (UniqueName: \"kubernetes.io/projected/b4833b06-42ff-458f-a2b1-7fd2a558cda8-kube-api-access-5ws9n\") pod \"limitador-operator-controller-manager-859d7b78bd-gpptx\" (UID: \"b4833b06-42ff-458f-a2b1-7fd2a558cda8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:40.426118 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.426064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8hzl\" (UniqueName: \"kubernetes.io/projected/a8650a9d-1d68-483a-92d9-f5401c77e681-kube-api-access-h8hzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n6pbk\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.515265 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.515232    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:40.518202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.518182    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:40.526621 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.526595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8hzl\" (UniqueName: \"kubernetes.io/projected/a8650a9d-1d68-483a-92d9-f5401c77e681-kube-api-access-h8hzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n6pbk\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.526771 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.526651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8650a9d-1d68-483a-92d9-f5401c77e681-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n6pbk\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.526771 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.526678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ws9n\" (UniqueName: \"kubernetes.io/projected/b4833b06-42ff-458f-a2b1-7fd2a558cda8-kube-api-access-5ws9n\") pod \"limitador-operator-controller-manager-859d7b78bd-gpptx\" (UID: \"b4833b06-42ff-458f-a2b1-7fd2a558cda8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:40.527023 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.527001    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8650a9d-1d68-483a-92d9-f5401c77e681-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n6pbk\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.543065 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.543031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8hzl\" (UniqueName: \"kubernetes.io/projected/a8650a9d-1d68-483a-92d9-f5401c77e681-kube-api-access-h8hzl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-n6pbk\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.545201 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.545175    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ws9n\" (UniqueName: \"kubernetes.io/projected/b4833b06-42ff-458f-a2b1-7fd2a558cda8-kube-api-access-5ws9n\") pod \"limitador-operator-controller-manager-859d7b78bd-gpptx\" (UID: \"b4833b06-42ff-458f-a2b1-7fd2a558cda8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:40.627592 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.627553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d9f910-7d91-467c-aa26-82d27f519f6b-extensions-socket-volume\") pod \"94d9f910-7d91-467c-aa26-82d27f519f6b\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") "
Jul 08 20:08:40.627733 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.627666    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dmlk\" (UniqueName: \"kubernetes.io/projected/d0ed3a9b-9a61-4486-98ae-40510eed194a-kube-api-access-6dmlk\") pod \"d0ed3a9b-9a61-4486-98ae-40510eed194a\" (UID: \"d0ed3a9b-9a61-4486-98ae-40510eed194a\") "
Jul 08 20:08:40.627733 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.627695    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hh28\" (UniqueName: \"kubernetes.io/projected/94d9f910-7d91-467c-aa26-82d27f519f6b-kube-api-access-6hh28\") pod \"94d9f910-7d91-467c-aa26-82d27f519f6b\" (UID: \"94d9f910-7d91-467c-aa26-82d27f519f6b\") "
Jul 08 20:08:40.628072 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.628047    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d9f910-7d91-467c-aa26-82d27f519f6b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94d9f910-7d91-467c-aa26-82d27f519f6b" (UID: "94d9f910-7d91-467c-aa26-82d27f519f6b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:08:40.629753 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.629727    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ed3a9b-9a61-4486-98ae-40510eed194a-kube-api-access-6dmlk" (OuterVolumeSpecName: "kube-api-access-6dmlk") pod "d0ed3a9b-9a61-4486-98ae-40510eed194a" (UID: "d0ed3a9b-9a61-4486-98ae-40510eed194a"). InnerVolumeSpecName "kube-api-access-6dmlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:08:40.629824 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.629809    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d9f910-7d91-467c-aa26-82d27f519f6b-kube-api-access-6hh28" (OuterVolumeSpecName: "kube-api-access-6hh28") pod "94d9f910-7d91-467c-aa26-82d27f519f6b" (UID: "94d9f910-7d91-467c-aa26-82d27f519f6b"). InnerVolumeSpecName "kube-api-access-6hh28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:08:40.675770 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.675735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:40.682019 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.681983    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:40.729413 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.729233    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dmlk\" (UniqueName: \"kubernetes.io/projected/d0ed3a9b-9a61-4486-98ae-40510eed194a-kube-api-access-6dmlk\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:08:40.729413 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.729266    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hh28\" (UniqueName: \"kubernetes.io/projected/94d9f910-7d91-467c-aa26-82d27f519f6b-kube-api-access-6hh28\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:08:40.729413 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.729282    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94d9f910-7d91-467c-aa26-82d27f519f6b-extensions-socket-volume\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:08:40.877229 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.877195    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"]
Jul 08 20:08:40.885257 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:08:40.885229    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8650a9d_1d68_483a_92d9_f5401c77e681.slice/crio-29a5bc08e1aa55f334a76345dadb46ee8c87b87b2efcaf25845d5724dd128bf9 WatchSource:0}: Error finding container 29a5bc08e1aa55f334a76345dadb46ee8c87b87b2efcaf25845d5724dd128bf9: Status 404 returned error can't find the container with id 29a5bc08e1aa55f334a76345dadb46ee8c87b87b2efcaf25845d5724dd128bf9
Jul 08 20:08:40.889166 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:40.889144    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"]
Jul 08 20:08:40.891956 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:08:40.891921    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4833b06_42ff_458f_a2b1_7fd2a558cda8.slice/crio-c96a9d8f9d7301ba76ad1da317738efb8fad3b7d6b3639af2a6781692174c48a WatchSource:0}: Error finding container c96a9d8f9d7301ba76ad1da317738efb8fad3b7d6b3639af2a6781692174c48a: Status 404 returned error can't find the container with id c96a9d8f9d7301ba76ad1da317738efb8fad3b7d6b3639af2a6781692174c48a
Jul 08 20:08:41.329083 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.329052    2582 generic.go:356] "Generic (PLEG): container finished" podID="d0ed3a9b-9a61-4486-98ae-40510eed194a" containerID="47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7" exitCode=0
Jul 08 20:08:41.329528 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.329098    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7zsg"
Jul 08 20:08:41.329528 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.329151    2582 scope.go:117] "RemoveContainer" containerID="47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7"
Jul 08 20:08:41.330971 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.330946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx" event={"ID":"b4833b06-42ff-458f-a2b1-7fd2a558cda8","Type":"ContainerStarted","Data":"a63f94a284ac70e8235456b8d2f72fc8280460b74d2f955fff3e2b1abe35a0d7"}
Jul 08 20:08:41.331112 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.331002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx" event={"ID":"b4833b06-42ff-458f-a2b1-7fd2a558cda8","Type":"ContainerStarted","Data":"c96a9d8f9d7301ba76ad1da317738efb8fad3b7d6b3639af2a6781692174c48a"}
Jul 08 20:08:41.331112 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.331032    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:41.332406 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.332380    2582 generic.go:356] "Generic (PLEG): container finished" podID="94d9f910-7d91-467c-aa26-82d27f519f6b" containerID="c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3" exitCode=0
Jul 08 20:08:41.332512 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.332424    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-smvdd"
Jul 08 20:08:41.334278 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.334251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk" event={"ID":"a8650a9d-1d68-483a-92d9-f5401c77e681","Type":"ContainerStarted","Data":"c6d7443f01bde2d00998c6e43a9a6bdc26daabf19450ea2968c61b9887489189"}
Jul 08 20:08:41.334412 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.334302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk" event={"ID":"a8650a9d-1d68-483a-92d9-f5401c77e681","Type":"ContainerStarted","Data":"29a5bc08e1aa55f334a76345dadb46ee8c87b87b2efcaf25845d5724dd128bf9"}
Jul 08 20:08:41.334537 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.334495    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:08:41.339758 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.339736    2582 scope.go:117] "RemoveContainer" containerID="47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7"
Jul 08 20:08:41.340077 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:41.340050    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7\": container with ID starting with 47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7 not found: ID does not exist" containerID="47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7"
Jul 08 20:08:41.340172 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.340084    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7"} err="failed to get container status \"47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7\": rpc error: code = NotFound desc = could not find container \"47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7\": container with ID starting with 47021b7c90fdf56e54ddc7a40b8336dac2037edc590563604957b01d52d464a7 not found: ID does not exist"
Jul 08 20:08:41.340172 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.340105    2582 scope.go:117] "RemoveContainer" containerID="c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3"
Jul 08 20:08:41.348169 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.348153    2582 scope.go:117] "RemoveContainer" containerID="c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3"
Jul 08 20:08:41.348447 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:08:41.348428    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3\": container with ID starting with c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3 not found: ID does not exist" containerID="c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3"
Jul 08 20:08:41.348498 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.348453    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3"} err="failed to get container status \"c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3\": rpc error: code = NotFound desc = could not find container \"c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3\": container with ID starting with c6bb284a431a9fa2f024a51e9830e348e8f8596657139607e8ded744e7d241e3 not found: ID does not exist"
Jul 08 20:08:41.363190 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.363142    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx" podStartSLOduration=1.363128403 podStartE2EDuration="1.363128403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:08:41.358979961 +0000 UTC m=+527.569986588" watchObservedRunningTime="2026-07-08 20:08:41.363128403 +0000 UTC m=+527.574135029"
Jul 08 20:08:41.393799 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:41.393750    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk" podStartSLOduration=1.393731928 podStartE2EDuration="1.393731928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:08:41.391367106 +0000 UTC m=+527.602373726" watchObservedRunningTime="2026-07-08 20:08:41.393731928 +0000 UTC m=+527.604738556"
Jul 08 20:08:42.317127 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:42.317092    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d9f910-7d91-467c-aa26-82d27f519f6b" path="/var/lib/kubelet/pods/94d9f910-7d91-467c-aa26-82d27f519f6b/volumes"
Jul 08 20:08:42.317477 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:42.317460    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0ed3a9b-9a61-4486-98ae-40510eed194a" path="/var/lib/kubelet/pods/d0ed3a9b-9a61-4486-98ae-40510eed194a/volumes"
Jul 08 20:08:52.343107 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:52.343032    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gpptx"
Jul 08 20:08:52.343577 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:08:52.343111    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:09:14.250956 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.250917    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"]
Jul 08 20:09:14.251456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.251157    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk" podUID="a8650a9d-1d68-483a-92d9-f5401c77e681" containerName="manager" containerID="cri-o://c6d7443f01bde2d00998c6e43a9a6bdc26daabf19450ea2968c61b9887489189" gracePeriod=10
Jul 08 20:09:14.480988 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.480952    2582 generic.go:356] "Generic (PLEG): container finished" podID="a8650a9d-1d68-483a-92d9-f5401c77e681" containerID="c6d7443f01bde2d00998c6e43a9a6bdc26daabf19450ea2968c61b9887489189" exitCode=0
Jul 08 20:09:14.481183 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.481012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk" event={"ID":"a8650a9d-1d68-483a-92d9-f5401c77e681","Type":"ContainerDied","Data":"c6d7443f01bde2d00998c6e43a9a6bdc26daabf19450ea2968c61b9887489189"}
Jul 08 20:09:14.508714 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.508643    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:09:14.597258 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.597229    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8hzl\" (UniqueName: \"kubernetes.io/projected/a8650a9d-1d68-483a-92d9-f5401c77e681-kube-api-access-h8hzl\") pod \"a8650a9d-1d68-483a-92d9-f5401c77e681\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") "
Jul 08 20:09:14.597440 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.597289    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8650a9d-1d68-483a-92d9-f5401c77e681-extensions-socket-volume\") pod \"a8650a9d-1d68-483a-92d9-f5401c77e681\" (UID: \"a8650a9d-1d68-483a-92d9-f5401c77e681\") "
Jul 08 20:09:14.597702 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.597677    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8650a9d-1d68-483a-92d9-f5401c77e681-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a8650a9d-1d68-483a-92d9-f5401c77e681" (UID: "a8650a9d-1d68-483a-92d9-f5401c77e681"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:09:14.599312 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.599290    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8650a9d-1d68-483a-92d9-f5401c77e681-kube-api-access-h8hzl" (OuterVolumeSpecName: "kube-api-access-h8hzl") pod "a8650a9d-1d68-483a-92d9-f5401c77e681" (UID: "a8650a9d-1d68-483a-92d9-f5401c77e681"). InnerVolumeSpecName "kube-api-access-h8hzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:09:14.698560 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.698524    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a8650a9d-1d68-483a-92d9-f5401c77e681-extensions-socket-volume\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:09:14.698560 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:14.698557    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8hzl\" (UniqueName: \"kubernetes.io/projected/a8650a9d-1d68-483a-92d9-f5401c77e681-kube-api-access-h8hzl\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:09:15.486509 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:15.486472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk" event={"ID":"a8650a9d-1d68-483a-92d9-f5401c77e681","Type":"ContainerDied","Data":"29a5bc08e1aa55f334a76345dadb46ee8c87b87b2efcaf25845d5724dd128bf9"}
Jul 08 20:09:15.486979 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:15.486530    2582 scope.go:117] "RemoveContainer" containerID="c6d7443f01bde2d00998c6e43a9a6bdc26daabf19450ea2968c61b9887489189"
Jul 08 20:09:15.486979 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:15.486489    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"
Jul 08 20:09:15.513939 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:15.513908    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"]
Jul 08 20:09:15.518877 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:15.518850    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-n6pbk"]
Jul 08 20:09:16.316233 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:16.316194    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8650a9d-1d68-483a-92d9-f5401c77e681" path="/var/lib/kubelet/pods/a8650a9d-1d68-483a-92d9-f5401c77e681/volumes"
Jul 08 20:09:30.817372 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.817293    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"]
Jul 08 20:09:30.817941 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.817870    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8650a9d-1d68-483a-92d9-f5401c77e681" containerName="manager"
Jul 08 20:09:30.817941 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.817891    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8650a9d-1d68-483a-92d9-f5401c77e681" containerName="manager"
Jul 08 20:09:30.818063 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.817965    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8650a9d-1d68-483a-92d9-f5401c77e681" containerName="manager"
Jul 08 20:09:30.821208 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.821185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.824664 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.824644    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kxcqv\""
Jul 08 20:09:30.835039 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.835010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"]
Jul 08 20:09:30.931803 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.931973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.931973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.931973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.931973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.931973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.932138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.931996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.932138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.932056    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stvxg\" (UniqueName: \"kubernetes.io/projected/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-kube-api-access-stvxg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:30.932138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:30.932092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033362 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stvxg\" (UniqueName: \"kubernetes.io/projected/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-kube-api-access-stvxg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033551 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033551 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033431    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033551 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033551 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033551 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033795 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033795 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.033795 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.034024 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.033903    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.034087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.034038    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.034087 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.034061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.034290 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.034256    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.034438 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.034344    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.035947 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.035925    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.036077 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.036060    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.043497 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.043472    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.043627 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.043610    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stvxg\" (UniqueName: \"kubernetes.io/projected/95b0d3dc-2826-4cf0-96e6-e17ad5549b67-kube-api-access-stvxg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-57jjm\" (UID: \"95b0d3dc-2826-4cf0-96e6-e17ad5549b67\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.131554 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.131444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:31.273424 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.273396    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"]
Jul 08 20:09:31.276144 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:09:31.276117    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b0d3dc_2826_4cf0_96e6_e17ad5549b67.slice/crio-152f594a70bd09ea69381ecb919a70d0c02a3c22424d8249a3a3a31ee8e7f64c WatchSource:0}: Error finding container 152f594a70bd09ea69381ecb919a70d0c02a3c22424d8249a3a3a31ee8e7f64c: Status 404 returned error can't find the container with id 152f594a70bd09ea69381ecb919a70d0c02a3c22424d8249a3a3a31ee8e7f64c
Jul 08 20:09:31.278740 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.278701    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:09:31.278831 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.278774    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:09:31.278831 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.278802    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:09:31.559901 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.559875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" event={"ID":"95b0d3dc-2826-4cf0-96e6-e17ad5549b67","Type":"ContainerStarted","Data":"31e33d6ade110e2741277baee654a29ab2bf183fddf0dbf54b5ac32171f211ba"}
Jul 08 20:09:31.560044 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.559926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" event={"ID":"95b0d3dc-2826-4cf0-96e6-e17ad5549b67","Type":"ContainerStarted","Data":"152f594a70bd09ea69381ecb919a70d0c02a3c22424d8249a3a3a31ee8e7f64c"}
Jul 08 20:09:31.591134 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:31.591079    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" podStartSLOduration=1.591056545 podStartE2EDuration="1.591056545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:09:31.587463434 +0000 UTC m=+577.798470059" watchObservedRunningTime="2026-07-08 20:09:31.591056545 +0000 UTC m=+577.802063174"
Jul 08 20:09:32.132065 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:32.132025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:32.136764 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:32.136737    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:32.564980 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:32.564949    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:32.565994 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:32.565975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:09:33.771390 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.771355    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:33.774686 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.774664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:33.778188 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.778163    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 20:09:33.778188 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.778163    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gwkxj\""
Jul 08 20:09:33.788009 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.787983    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:33.857756 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.857722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4344f66-8ed6-48d5-931f-244083206986-config-file\") pod \"limitador-limitador-64c94fd64f-r25hk\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:33.857756 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.857759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rff9h\" (UniqueName: \"kubernetes.io/projected/b4344f66-8ed6-48d5-931f-244083206986-kube-api-access-rff9h\") pod \"limitador-limitador-64c94fd64f-r25hk\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:33.869410 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.869371    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:33.959063 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.959021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4344f66-8ed6-48d5-931f-244083206986-config-file\") pod \"limitador-limitador-64c94fd64f-r25hk\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:33.959229 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.959070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rff9h\" (UniqueName: \"kubernetes.io/projected/b4344f66-8ed6-48d5-931f-244083206986-kube-api-access-rff9h\") pod \"limitador-limitador-64c94fd64f-r25hk\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:33.959658 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.959633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4344f66-8ed6-48d5-931f-244083206986-config-file\") pod \"limitador-limitador-64c94fd64f-r25hk\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:33.970147 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:33.968957    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rff9h\" (UniqueName: \"kubernetes.io/projected/b4344f66-8ed6-48d5-931f-244083206986-kube-api-access-rff9h\") pod \"limitador-limitador-64c94fd64f-r25hk\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:34.084933 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.084892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:34.217342 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.217180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:34.219372 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:09:34.219345    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4344f66_8ed6_48d5_931f_244083206986.slice/crio-5a5e3ccda1fb9b97aee26747acbc9147064fd26685b834092893a5d5bf619354 WatchSource:0}: Error finding container 5a5e3ccda1fb9b97aee26747acbc9147064fd26685b834092893a5d5bf619354: Status 404 returned error can't find the container with id 5a5e3ccda1fb9b97aee26747acbc9147064fd26685b834092893a5d5bf619354
Jul 08 20:09:34.574192 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.574152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk" event={"ID":"b4344f66-8ed6-48d5-931f-244083206986","Type":"ContainerStarted","Data":"5a5e3ccda1fb9b97aee26747acbc9147064fd26685b834092893a5d5bf619354"}
Jul 08 20:09:34.656686 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.656653    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4kg5q"]
Jul 08 20:09:34.666894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.666862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:34.668863 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.668835    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4kg5q"]
Jul 08 20:09:34.670205 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.670175    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qp2tm\""
Jul 08 20:09:34.766804 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.766771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncbkz\" (UniqueName: \"kubernetes.io/projected/241f1b3a-3509-4cbd-a7e7-cc4707f5636b-kube-api-access-ncbkz\") pod \"authorino-58cd955675-4kg5q\" (UID: \"241f1b3a-3509-4cbd-a7e7-cc4707f5636b\") " pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:34.821790 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.821757    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hzdsw"]
Jul 08 20:09:34.824994 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.824951    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:09:34.833376 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.833347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hzdsw"]
Jul 08 20:09:34.867390 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.867354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncbkz\" (UniqueName: \"kubernetes.io/projected/241f1b3a-3509-4cbd-a7e7-cc4707f5636b-kube-api-access-ncbkz\") pod \"authorino-58cd955675-4kg5q\" (UID: \"241f1b3a-3509-4cbd-a7e7-cc4707f5636b\") " pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:34.877648 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.877611    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncbkz\" (UniqueName: \"kubernetes.io/projected/241f1b3a-3509-4cbd-a7e7-cc4707f5636b-kube-api-access-ncbkz\") pod \"authorino-58cd955675-4kg5q\" (UID: \"241f1b3a-3509-4cbd-a7e7-cc4707f5636b\") " pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:34.967941 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.967897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlrt\" (UniqueName: \"kubernetes.io/projected/8eb395c3-6135-473c-a106-f0550fa4a535-kube-api-access-hrlrt\") pod \"authorino-75d556bd77-hzdsw\" (UID: \"8eb395c3-6135-473c-a106-f0550fa4a535\") " pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:09:34.976768 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:34.976744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:35.069416 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.069372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlrt\" (UniqueName: \"kubernetes.io/projected/8eb395c3-6135-473c-a106-f0550fa4a535-kube-api-access-hrlrt\") pod \"authorino-75d556bd77-hzdsw\" (UID: \"8eb395c3-6135-473c-a106-f0550fa4a535\") " pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:09:35.079416 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.079310    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlrt\" (UniqueName: \"kubernetes.io/projected/8eb395c3-6135-473c-a106-f0550fa4a535-kube-api-access-hrlrt\") pod \"authorino-75d556bd77-hzdsw\" (UID: \"8eb395c3-6135-473c-a106-f0550fa4a535\") " pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:09:35.134586 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.134545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:09:35.145537 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.145501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4kg5q"]
Jul 08 20:09:35.151820 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:09:35.151640    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod241f1b3a_3509_4cbd_a7e7_cc4707f5636b.slice/crio-776ae44c1d663ca5c78771145551c6a3b02a92e08ab4cc5af093dc0d8ac75588 WatchSource:0}: Error finding container 776ae44c1d663ca5c78771145551c6a3b02a92e08ab4cc5af093dc0d8ac75588: Status 404 returned error can't find the container with id 776ae44c1d663ca5c78771145551c6a3b02a92e08ab4cc5af093dc0d8ac75588
Jul 08 20:09:35.319540 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.319501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hzdsw"]
Jul 08 20:09:35.322940 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:09:35.322906    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eb395c3_6135_473c_a106_f0550fa4a535.slice/crio-3637c5ea2d957c7b7c198cb230edb8b95244e651064e36bc1dacd0d2275e40e0 WatchSource:0}: Error finding container 3637c5ea2d957c7b7c198cb230edb8b95244e651064e36bc1dacd0d2275e40e0: Status 404 returned error can't find the container with id 3637c5ea2d957c7b7c198cb230edb8b95244e651064e36bc1dacd0d2275e40e0
Jul 08 20:09:35.580206 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.580171    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4kg5q" event={"ID":"241f1b3a-3509-4cbd-a7e7-cc4707f5636b","Type":"ContainerStarted","Data":"776ae44c1d663ca5c78771145551c6a3b02a92e08ab4cc5af093dc0d8ac75588"}
Jul 08 20:09:35.581656 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:35.581621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hzdsw" event={"ID":"8eb395c3-6135-473c-a106-f0550fa4a535","Type":"ContainerStarted","Data":"3637c5ea2d957c7b7c198cb230edb8b95244e651064e36bc1dacd0d2275e40e0"}
Jul 08 20:09:37.597112 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:37.596676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk" event={"ID":"b4344f66-8ed6-48d5-931f-244083206986","Type":"ContainerStarted","Data":"66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc"}
Jul 08 20:09:37.597112 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:37.596932    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:37.620731 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:37.620263    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk" podStartSLOduration=1.622828352 podStartE2EDuration="4.620243299s" totalImagesPullingTime="2.997414947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:09:37.617929212 +0000 UTC m=+583.828935841" watchObservedRunningTime="2026-07-08 20:09:37.620243299 +0000 UTC m=+583.831249927"
Jul 08 20:09:40.617390 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:40.617350    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hzdsw" event={"ID":"8eb395c3-6135-473c-a106-f0550fa4a535","Type":"ContainerStarted","Data":"1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1"}
Jul 08 20:09:40.618920 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:40.618896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4kg5q" event={"ID":"241f1b3a-3509-4cbd-a7e7-cc4707f5636b","Type":"ContainerStarted","Data":"e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347"}
Jul 08 20:09:40.636236 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:40.636188    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hzdsw" podStartSLOduration=2.346649292 podStartE2EDuration="6.63617587s" totalImagesPullingTime="4.289526578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:09:40.633819527 +0000 UTC m=+586.844826153" watchObservedRunningTime="2026-07-08 20:09:40.63617587 +0000 UTC m=+586.847182496"
Jul 08 20:09:40.654035 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:40.653965    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4kg5q" podStartSLOduration=2.182283086 podStartE2EDuration="6.653947499s" totalImagesPullingTime="4.471664413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:09:40.652528174 +0000 UTC m=+586.863534812" watchObservedRunningTime="2026-07-08 20:09:40.653947499 +0000 UTC m=+586.864954126"
Jul 08 20:09:40.687046 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:40.687012    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4kg5q"]
Jul 08 20:09:42.627710 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:42.627667    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4kg5q" podUID="241f1b3a-3509-4cbd-a7e7-cc4707f5636b" containerName="authorino" containerID="cri-o://e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347" gracePeriod=30
Jul 08 20:09:42.884994 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:42.884927    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:43.041181 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.041148    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncbkz\" (UniqueName: \"kubernetes.io/projected/241f1b3a-3509-4cbd-a7e7-cc4707f5636b-kube-api-access-ncbkz\") pod \"241f1b3a-3509-4cbd-a7e7-cc4707f5636b\" (UID: \"241f1b3a-3509-4cbd-a7e7-cc4707f5636b\") "
Jul 08 20:09:43.043179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.043145    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241f1b3a-3509-4cbd-a7e7-cc4707f5636b-kube-api-access-ncbkz" (OuterVolumeSpecName: "kube-api-access-ncbkz") pod "241f1b3a-3509-4cbd-a7e7-cc4707f5636b" (UID: "241f1b3a-3509-4cbd-a7e7-cc4707f5636b"). InnerVolumeSpecName "kube-api-access-ncbkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:09:43.142109 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.142016    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncbkz\" (UniqueName: \"kubernetes.io/projected/241f1b3a-3509-4cbd-a7e7-cc4707f5636b-kube-api-access-ncbkz\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:09:43.633206 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.633169    2582 generic.go:356] "Generic (PLEG): container finished" podID="241f1b3a-3509-4cbd-a7e7-cc4707f5636b" containerID="e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347" exitCode=0
Jul 08 20:09:43.633206 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.633208    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4kg5q"
Jul 08 20:09:43.633688 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.633258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4kg5q" event={"ID":"241f1b3a-3509-4cbd-a7e7-cc4707f5636b","Type":"ContainerDied","Data":"e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347"}
Jul 08 20:09:43.633688 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.633303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4kg5q" event={"ID":"241f1b3a-3509-4cbd-a7e7-cc4707f5636b","Type":"ContainerDied","Data":"776ae44c1d663ca5c78771145551c6a3b02a92e08ab4cc5af093dc0d8ac75588"}
Jul 08 20:09:43.633688 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.633340    2582 scope.go:117] "RemoveContainer" containerID="e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347"
Jul 08 20:09:43.641917 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.641898    2582 scope.go:117] "RemoveContainer" containerID="e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347"
Jul 08 20:09:43.642198 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:09:43.642179    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347\": container with ID starting with e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347 not found: ID does not exist" containerID="e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347"
Jul 08 20:09:43.642245 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.642209    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347"} err="failed to get container status \"e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347\": rpc error: code = NotFound desc = could not find container \"e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347\": container with ID starting with e60a07d8e16150ade157d77f525319d2e5c866a1053522a9da630e35c62c6347 not found: ID does not exist"
Jul 08 20:09:43.657273 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.657244    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4kg5q"]
Jul 08 20:09:43.663712 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:43.663686    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4kg5q"]
Jul 08 20:09:44.317104 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:44.317070    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241f1b3a-3509-4cbd-a7e7-cc4707f5636b" path="/var/lib/kubelet/pods/241f1b3a-3509-4cbd-a7e7-cc4707f5636b/volumes"
Jul 08 20:09:48.595613 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:48.595574    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:48.596116 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:48.595763    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk" podUID="b4344f66-8ed6-48d5-931f-244083206986" containerName="limitador" containerID="cri-o://66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc" gracePeriod=30
Jul 08 20:09:48.596511 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:48.596490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:49.156888 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.156823    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:49.298546 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.298515    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4344f66-8ed6-48d5-931f-244083206986-config-file\") pod \"b4344f66-8ed6-48d5-931f-244083206986\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") "
Jul 08 20:09:49.298723 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.298616    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rff9h\" (UniqueName: \"kubernetes.io/projected/b4344f66-8ed6-48d5-931f-244083206986-kube-api-access-rff9h\") pod \"b4344f66-8ed6-48d5-931f-244083206986\" (UID: \"b4344f66-8ed6-48d5-931f-244083206986\") "
Jul 08 20:09:49.298904 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.298871    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4344f66-8ed6-48d5-931f-244083206986-config-file" (OuterVolumeSpecName: "config-file") pod "b4344f66-8ed6-48d5-931f-244083206986" (UID: "b4344f66-8ed6-48d5-931f-244083206986"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 20:09:49.300738 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.300717    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4344f66-8ed6-48d5-931f-244083206986-kube-api-access-rff9h" (OuterVolumeSpecName: "kube-api-access-rff9h") pod "b4344f66-8ed6-48d5-931f-244083206986" (UID: "b4344f66-8ed6-48d5-931f-244083206986"). InnerVolumeSpecName "kube-api-access-rff9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:09:49.399284 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.399247    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rff9h\" (UniqueName: \"kubernetes.io/projected/b4344f66-8ed6-48d5-931f-244083206986-kube-api-access-rff9h\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:09:49.399284 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.399275    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4344f66-8ed6-48d5-931f-244083206986-config-file\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:09:49.662709 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.662678    2582 generic.go:356] "Generic (PLEG): container finished" podID="b4344f66-8ed6-48d5-931f-244083206986" containerID="66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc" exitCode=0
Jul 08 20:09:49.663128 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.662721    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk"
Jul 08 20:09:49.663128 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.662732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk" event={"ID":"b4344f66-8ed6-48d5-931f-244083206986","Type":"ContainerDied","Data":"66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc"}
Jul 08 20:09:49.663128 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.662772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r25hk" event={"ID":"b4344f66-8ed6-48d5-931f-244083206986","Type":"ContainerDied","Data":"5a5e3ccda1fb9b97aee26747acbc9147064fd26685b834092893a5d5bf619354"}
Jul 08 20:09:49.663128 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.662793    2582 scope.go:117] "RemoveContainer" containerID="66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc"
Jul 08 20:09:49.671304 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.671285    2582 scope.go:117] "RemoveContainer" containerID="66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc"
Jul 08 20:09:49.671583 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:09:49.671565    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc\": container with ID starting with 66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc not found: ID does not exist" containerID="66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc"
Jul 08 20:09:49.671651 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.671590    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc"} err="failed to get container status \"66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc\": rpc error: code = NotFound desc = could not find container \"66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc\": container with ID starting with 66eb9be8544bf2471c3e985ba49e9d83014054d62a7bb831e484727cd6232bbc not found: ID does not exist"
Jul 08 20:09:49.685183 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.685154    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:49.689232 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:49.689203    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r25hk"]
Jul 08 20:09:50.321085 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:50.321049    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4344f66-8ed6-48d5-931f-244083206986" path="/var/lib/kubelet/pods/b4344f66-8ed6-48d5-931f-244083206986/volumes"
Jul 08 20:09:54.741762 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.741728    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"]
Jul 08 20:09:54.742204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.742104    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4344f66-8ed6-48d5-931f-244083206986" containerName="limitador"
Jul 08 20:09:54.742204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.742117    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4344f66-8ed6-48d5-931f-244083206986" containerName="limitador"
Jul 08 20:09:54.742204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.742126    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241f1b3a-3509-4cbd-a7e7-cc4707f5636b" containerName="authorino"
Jul 08 20:09:54.742204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.742131    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="241f1b3a-3509-4cbd-a7e7-cc4707f5636b" containerName="authorino"
Jul 08 20:09:54.742204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.742183    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4344f66-8ed6-48d5-931f-244083206986" containerName="limitador"
Jul 08 20:09:54.742204 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.742193    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="241f1b3a-3509-4cbd-a7e7-cc4707f5636b" containerName="authorino"
Jul 08 20:09:54.747308 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.747282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:54.750348 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.750306    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 20:09:54.750452 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.750395    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 20:09:54.751568 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.751539    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2cbjv\""
Jul 08 20:09:54.751658 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.751551    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 20:09:54.755655 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.755631    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"]
Jul 08 20:09:54.946195 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.946159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlsch\" (UniqueName: \"kubernetes.io/projected/e7849aba-5685-473a-89d7-308b481cd4c8-kube-api-access-hlsch\") pod \"postgres-69fb4594cf-bnv79\" (UID: \"e7849aba-5685-473a-89d7-308b481cd4c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:54.946415 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:54.946245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7849aba-5685-473a-89d7-308b481cd4c8-data\") pod \"postgres-69fb4594cf-bnv79\" (UID: \"e7849aba-5685-473a-89d7-308b481cd4c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:55.047426 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.047342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlsch\" (UniqueName: \"kubernetes.io/projected/e7849aba-5685-473a-89d7-308b481cd4c8-kube-api-access-hlsch\") pod \"postgres-69fb4594cf-bnv79\" (UID: \"e7849aba-5685-473a-89d7-308b481cd4c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:55.047426 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.047405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7849aba-5685-473a-89d7-308b481cd4c8-data\") pod \"postgres-69fb4594cf-bnv79\" (UID: \"e7849aba-5685-473a-89d7-308b481cd4c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:55.047756 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.047739    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e7849aba-5685-473a-89d7-308b481cd4c8-data\") pod \"postgres-69fb4594cf-bnv79\" (UID: \"e7849aba-5685-473a-89d7-308b481cd4c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:55.056368 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.056343    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlsch\" (UniqueName: \"kubernetes.io/projected/e7849aba-5685-473a-89d7-308b481cd4c8-kube-api-access-hlsch\") pod \"postgres-69fb4594cf-bnv79\" (UID: \"e7849aba-5685-473a-89d7-308b481cd4c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:55.058121 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.058102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:09:55.192138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.192100    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"]
Jul 08 20:09:55.195227 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:09:55.195199    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7849aba_5685_473a_89d7_308b481cd4c8.slice/crio-fb01984e28d9e09c1a8d720e6cfe161fe7ea629f103eef3124646e33274e0706 WatchSource:0}: Error finding container fb01984e28d9e09c1a8d720e6cfe161fe7ea629f103eef3124646e33274e0706: Status 404 returned error can't find the container with id fb01984e28d9e09c1a8d720e6cfe161fe7ea629f103eef3124646e33274e0706
Jul 08 20:09:55.690510 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:09:55.690475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79" event={"ID":"e7849aba-5685-473a-89d7-308b481cd4c8","Type":"ContainerStarted","Data":"fb01984e28d9e09c1a8d720e6cfe161fe7ea629f103eef3124646e33274e0706"}
Jul 08 20:10:01.724026 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:01.723979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79" event={"ID":"e7849aba-5685-473a-89d7-308b481cd4c8","Type":"ContainerStarted","Data":"8224f7d01b51c8f6135bc91bdc15baffb8b8c89cd62f3056c88ebca2c18d7fae"}
Jul 08 20:10:01.724564 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:01.724125    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:10:01.744629 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:01.744557    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79" podStartSLOduration=1.994159185 podStartE2EDuration="7.744532926s" totalImagesPullingTime="5.750373741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:10:01.742035542 +0000 UTC m=+607.953042151" watchObservedRunningTime="2026-07-08 20:10:01.744532926 +0000 UTC m=+607.955539629"
Jul 08 20:10:07.759462 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:07.759432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bnv79"
Jul 08 20:10:08.436807 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.436773    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hghd"]
Jul 08 20:10:08.441264 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.441224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:08.446009 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.445971    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqcs4\" (UniqueName: \"kubernetes.io/projected/3722c2bb-202a-419a-9cb7-537986ad3b9f-kube-api-access-wqcs4\") pod \"authorino-5d4b67c446-2hghd\" (UID: \"3722c2bb-202a-419a-9cb7-537986ad3b9f\") " pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:08.467276 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.467243    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hghd"]
Jul 08 20:10:08.547233 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.547188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqcs4\" (UniqueName: \"kubernetes.io/projected/3722c2bb-202a-419a-9cb7-537986ad3b9f-kube-api-access-wqcs4\") pod \"authorino-5d4b67c446-2hghd\" (UID: \"3722c2bb-202a-419a-9cb7-537986ad3b9f\") " pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:08.557475 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.557450    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqcs4\" (UniqueName: \"kubernetes.io/projected/3722c2bb-202a-419a-9cb7-537986ad3b9f-kube-api-access-wqcs4\") pod \"authorino-5d4b67c446-2hghd\" (UID: \"3722c2bb-202a-419a-9cb7-537986ad3b9f\") " pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:08.682947 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.682901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hghd"]
Jul 08 20:10:08.683207 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.683189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:08.712183 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.712151    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58477c4d69-vm78k"]
Jul 08 20:10:08.716627 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.716607    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:08.728359 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.728331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58477c4d69-vm78k"]
Jul 08 20:10:08.748831 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.748799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sz29\" (UniqueName: \"kubernetes.io/projected/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16-kube-api-access-4sz29\") pod \"authorino-58477c4d69-vm78k\" (UID: \"f2bfd2c9-c28d-49f9-8bd6-d8f117572a16\") " pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:08.813804 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.813770    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58477c4d69-vm78k"]
Jul 08 20:10:08.814194 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:10:08.814031    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4sz29], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-58477c4d69-vm78k" podUID="f2bfd2c9-c28d-49f9-8bd6-d8f117572a16"
Jul 08 20:10:08.829495 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.829465    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hghd"]
Jul 08 20:10:08.833041 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:10:08.833020    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3722c2bb_202a_419a_9cb7_537986ad3b9f.slice/crio-cb1114b1954c012c2589bad23a2021612ccae365ecb790b59ac6c610f412f932 WatchSource:0}: Error finding container cb1114b1954c012c2589bad23a2021612ccae365ecb790b59ac6c610f412f932: Status 404 returned error can't find the container with id cb1114b1954c012c2589bad23a2021612ccae365ecb790b59ac6c610f412f932
Jul 08 20:10:08.845480 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.845453    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75b6ff94d9-4vxhg"]
Jul 08 20:10:08.848957 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.848937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:08.849431 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.849412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sz29\" (UniqueName: \"kubernetes.io/projected/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16-kube-api-access-4sz29\") pod \"authorino-58477c4d69-vm78k\" (UID: \"f2bfd2c9-c28d-49f9-8bd6-d8f117572a16\") " pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:08.849505 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.849443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7056693-38cf-49ac-9531-3d177c63e144-tls-cert\") pod \"authorino-75b6ff94d9-4vxhg\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") " pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:08.849544 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.849516    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tspmv\" (UniqueName: \"kubernetes.io/projected/e7056693-38cf-49ac-9531-3d177c63e144-kube-api-access-tspmv\") pod \"authorino-75b6ff94d9-4vxhg\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") " pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:08.852576 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.852559    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 20:10:08.864728 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.864704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b6ff94d9-4vxhg"]
Jul 08 20:10:08.867667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.867646    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sz29\" (UniqueName: \"kubernetes.io/projected/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16-kube-api-access-4sz29\") pod \"authorino-58477c4d69-vm78k\" (UID: \"f2bfd2c9-c28d-49f9-8bd6-d8f117572a16\") " pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:08.949851 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.949770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7056693-38cf-49ac-9531-3d177c63e144-tls-cert\") pod \"authorino-75b6ff94d9-4vxhg\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") " pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:08.949851 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.949827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspmv\" (UniqueName: \"kubernetes.io/projected/e7056693-38cf-49ac-9531-3d177c63e144-kube-api-access-tspmv\") pod \"authorino-75b6ff94d9-4vxhg\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") " pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:08.952138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.952119    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7056693-38cf-49ac-9531-3d177c63e144-tls-cert\") pod \"authorino-75b6ff94d9-4vxhg\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") " pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:08.958760 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:08.958726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tspmv\" (UniqueName: \"kubernetes.io/projected/e7056693-38cf-49ac-9531-3d177c63e144-kube-api-access-tspmv\") pod \"authorino-75b6ff94d9-4vxhg\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") " pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:09.158276 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.158255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:10:09.311468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.311432    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75b6ff94d9-4vxhg"]
Jul 08 20:10:09.314617 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:10:09.314591    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7056693_38cf_49ac_9531_3d177c63e144.slice/crio-a41ad1f724cba7a8fba57dca2f1d6dd374686db9e297e567cfc982e6c1ba1cc8 WatchSource:0}: Error finding container a41ad1f724cba7a8fba57dca2f1d6dd374686db9e297e567cfc982e6c1ba1cc8: Status 404 returned error can't find the container with id a41ad1f724cba7a8fba57dca2f1d6dd374686db9e297e567cfc982e6c1ba1cc8
Jul 08 20:10:09.761440 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.761414    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg" event={"ID":"e7056693-38cf-49ac-9531-3d177c63e144","Type":"ContainerStarted","Data":"a41ad1f724cba7a8fba57dca2f1d6dd374686db9e297e567cfc982e6c1ba1cc8"}
Jul 08 20:10:09.762898 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.762871    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hghd" event={"ID":"3722c2bb-202a-419a-9cb7-537986ad3b9f","Type":"ContainerStarted","Data":"d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4"}
Jul 08 20:10:09.763016 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.762908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:09.763016 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.762913    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2hghd" podUID="3722c2bb-202a-419a-9cb7-537986ad3b9f" containerName="authorino" containerID="cri-o://d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4" gracePeriod=30
Jul 08 20:10:09.763119 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.762909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hghd" event={"ID":"3722c2bb-202a-419a-9cb7-537986ad3b9f","Type":"ContainerStarted","Data":"cb1114b1954c012c2589bad23a2021612ccae365ecb790b59ac6c610f412f932"}
Jul 08 20:10:09.771519 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.771498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:09.789559 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.789507    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2hghd" podStartSLOduration=1.468668174 podStartE2EDuration="1.789488673s" totalImagesPullingTime="320.820499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:10:09.788457027 +0000 UTC m=+615.999463653" watchObservedRunningTime="2026-07-08 20:10:09.789488673 +0000 UTC m=+616.000495316"
Jul 08 20:10:09.858062 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.858016    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sz29\" (UniqueName: \"kubernetes.io/projected/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16-kube-api-access-4sz29\") pod \"f2bfd2c9-c28d-49f9-8bd6-d8f117572a16\" (UID: \"f2bfd2c9-c28d-49f9-8bd6-d8f117572a16\") "
Jul 08 20:10:09.860165 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.860141    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16-kube-api-access-4sz29" (OuterVolumeSpecName: "kube-api-access-4sz29") pod "f2bfd2c9-c28d-49f9-8bd6-d8f117572a16" (UID: "f2bfd2c9-c28d-49f9-8bd6-d8f117572a16"). InnerVolumeSpecName "kube-api-access-4sz29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:10:09.959364 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:09.959295    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sz29\" (UniqueName: \"kubernetes.io/projected/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16-kube-api-access-4sz29\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:10:10.016834 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.016808    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:10.160668 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.160636    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqcs4\" (UniqueName: \"kubernetes.io/projected/3722c2bb-202a-419a-9cb7-537986ad3b9f-kube-api-access-wqcs4\") pod \"3722c2bb-202a-419a-9cb7-537986ad3b9f\" (UID: \"3722c2bb-202a-419a-9cb7-537986ad3b9f\") "
Jul 08 20:10:10.162722 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.162695    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3722c2bb-202a-419a-9cb7-537986ad3b9f-kube-api-access-wqcs4" (OuterVolumeSpecName: "kube-api-access-wqcs4") pod "3722c2bb-202a-419a-9cb7-537986ad3b9f" (UID: "3722c2bb-202a-419a-9cb7-537986ad3b9f"). InnerVolumeSpecName "kube-api-access-wqcs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:10:10.261375 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.261268    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqcs4\" (UniqueName: \"kubernetes.io/projected/3722c2bb-202a-419a-9cb7-537986ad3b9f-kube-api-access-wqcs4\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:10:10.768467 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.768429    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg" event={"ID":"e7056693-38cf-49ac-9531-3d177c63e144","Type":"ContainerStarted","Data":"199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a"}
Jul 08 20:10:10.769596 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.769570    2582 generic.go:356] "Generic (PLEG): container finished" podID="3722c2bb-202a-419a-9cb7-537986ad3b9f" containerID="d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4" exitCode=0
Jul 08 20:10:10.769596 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.769603    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2hghd"
Jul 08 20:10:10.769754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.769639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hghd" event={"ID":"3722c2bb-202a-419a-9cb7-537986ad3b9f","Type":"ContainerDied","Data":"d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4"}
Jul 08 20:10:10.769754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.769679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2hghd" event={"ID":"3722c2bb-202a-419a-9cb7-537986ad3b9f","Type":"ContainerDied","Data":"cb1114b1954c012c2589bad23a2021612ccae365ecb790b59ac6c610f412f932"}
Jul 08 20:10:10.769754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.769700    2582 scope.go:117] "RemoveContainer" containerID="d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4"
Jul 08 20:10:10.769862 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.769816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58477c4d69-vm78k"
Jul 08 20:10:10.778215 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.778193    2582 scope.go:117] "RemoveContainer" containerID="d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4"
Jul 08 20:10:10.778509 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:10:10.778490    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4\": container with ID starting with d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4 not found: ID does not exist" containerID="d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4"
Jul 08 20:10:10.778616 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.778517    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4"} err="failed to get container status \"d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4\": rpc error: code = NotFound desc = could not find container \"d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4\": container with ID starting with d57b108ab76947892a85bd4d44878122e1766a29559ff5710f923190c68bb4c4 not found: ID does not exist"
Jul 08 20:10:10.788909 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.788861    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg" podStartSLOduration=2.389095235 podStartE2EDuration="2.788847336s" totalImagesPullingTime="399.752101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:10:10.787427898 +0000 UTC m=+616.998434526" watchObservedRunningTime="2026-07-08 20:10:10.788847336 +0000 UTC m=+616.999853961"
Jul 08 20:10:10.815462 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.815387    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58477c4d69-vm78k"]
Jul 08 20:10:10.822199 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.822170    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hzdsw"]
Jul 08 20:10:10.822444 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.822418    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hzdsw" podUID="8eb395c3-6135-473c-a106-f0550fa4a535" containerName="authorino" containerID="cri-o://1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1" gracePeriod=30
Jul 08 20:10:10.826191 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.826154    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58477c4d69-vm78k"]
Jul 08 20:10:10.840341 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.840292    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hghd"]
Jul 08 20:10:10.842589 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:10.842567    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2hghd"]
Jul 08 20:10:11.070508 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.070446    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:10:11.167003 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.166958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrlrt\" (UniqueName: \"kubernetes.io/projected/8eb395c3-6135-473c-a106-f0550fa4a535-kube-api-access-hrlrt\") pod \"8eb395c3-6135-473c-a106-f0550fa4a535\" (UID: \"8eb395c3-6135-473c-a106-f0550fa4a535\") "
Jul 08 20:10:11.168976 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.168947    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb395c3-6135-473c-a106-f0550fa4a535-kube-api-access-hrlrt" (OuterVolumeSpecName: "kube-api-access-hrlrt") pod "8eb395c3-6135-473c-a106-f0550fa4a535" (UID: "8eb395c3-6135-473c-a106-f0550fa4a535"). InnerVolumeSpecName "kube-api-access-hrlrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:10:11.267609 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.267570    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrlrt\" (UniqueName: \"kubernetes.io/projected/8eb395c3-6135-473c-a106-f0550fa4a535-kube-api-access-hrlrt\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:10:11.776650 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.776617    2582 generic.go:356] "Generic (PLEG): container finished" podID="8eb395c3-6135-473c-a106-f0550fa4a535" containerID="1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1" exitCode=0
Jul 08 20:10:11.776848 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.776672    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hzdsw"
Jul 08 20:10:11.776848 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.776706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hzdsw" event={"ID":"8eb395c3-6135-473c-a106-f0550fa4a535","Type":"ContainerDied","Data":"1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1"}
Jul 08 20:10:11.776848 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.776751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hzdsw" event={"ID":"8eb395c3-6135-473c-a106-f0550fa4a535","Type":"ContainerDied","Data":"3637c5ea2d957c7b7c198cb230edb8b95244e651064e36bc1dacd0d2275e40e0"}
Jul 08 20:10:11.776848 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.776772    2582 scope.go:117] "RemoveContainer" containerID="1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1"
Jul 08 20:10:11.785053 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.785037    2582 scope.go:117] "RemoveContainer" containerID="1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1"
Jul 08 20:10:11.785294 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:10:11.785274    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1\": container with ID starting with 1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1 not found: ID does not exist" containerID="1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1"
Jul 08 20:10:11.785427 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.785302    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1"} err="failed to get container status \"1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1\": rpc error: code = NotFound desc = could not find container \"1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1\": container with ID starting with 1737fb78cfc94a188ff3773560f9ceabfea6a1461bcf707bc20b6271e4eec9e1 not found: ID does not exist"
Jul 08 20:10:11.801514 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.801488    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hzdsw"]
Jul 08 20:10:11.804514 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:11.804490    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hzdsw"]
Jul 08 20:10:12.316828 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:12.316791    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3722c2bb-202a-419a-9cb7-537986ad3b9f" path="/var/lib/kubelet/pods/3722c2bb-202a-419a-9cb7-537986ad3b9f/volumes"
Jul 08 20:10:12.317188 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:12.317102    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb395c3-6135-473c-a106-f0550fa4a535" path="/var/lib/kubelet/pods/8eb395c3-6135-473c-a106-f0550fa4a535/volumes"
Jul 08 20:10:12.317424 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:12.317410    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2bfd2c9-c28d-49f9-8bd6-d8f117572a16" path="/var/lib/kubelet/pods/f2bfd2c9-c28d-49f9-8bd6-d8f117572a16/volumes"
Jul 08 20:10:16.023512 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.023471    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-w5p5n"]
Jul 08 20:10:16.024020 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.024000    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3722c2bb-202a-419a-9cb7-537986ad3b9f" containerName="authorino"
Jul 08 20:10:16.024138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.024023    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3722c2bb-202a-419a-9cb7-537986ad3b9f" containerName="authorino"
Jul 08 20:10:16.024138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.024034    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb395c3-6135-473c-a106-f0550fa4a535" containerName="authorino"
Jul 08 20:10:16.024138 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.024042    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb395c3-6135-473c-a106-f0550fa4a535" containerName="authorino"
Jul 08 20:10:16.024287 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.024140    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb395c3-6135-473c-a106-f0550fa4a535" containerName="authorino"
Jul 08 20:10:16.024287 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.024158    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3722c2bb-202a-419a-9cb7-537986ad3b9f" containerName="authorino"
Jul 08 20:10:16.028547 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.028524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.031656 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.031635    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 20:10:16.032884 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.032868    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 20:10:16.032987 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.032968    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p5v28\""
Jul 08 20:10:16.042731 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.042704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-w5p5n"]
Jul 08 20:10:16.100667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.100625    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqlpg\" (UniqueName: \"kubernetes.io/projected/84047bd1-10d9-4440-9006-adf9505edb94-kube-api-access-zqlpg\") pod \"maas-controller-6bbb8c8848-w5p5n\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") " pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.100829 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.100715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84047bd1-10d9-4440-9006-adf9505edb94-webhook-cert\") pod \"maas-controller-6bbb8c8848-w5p5n\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") " pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.201389 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.201344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqlpg\" (UniqueName: \"kubernetes.io/projected/84047bd1-10d9-4440-9006-adf9505edb94-kube-api-access-zqlpg\") pod \"maas-controller-6bbb8c8848-w5p5n\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") " pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.201554 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.201399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84047bd1-10d9-4440-9006-adf9505edb94-webhook-cert\") pod \"maas-controller-6bbb8c8848-w5p5n\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") " pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.203756 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.203725    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84047bd1-10d9-4440-9006-adf9505edb94-webhook-cert\") pod \"maas-controller-6bbb8c8848-w5p5n\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") " pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.213632 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.213611    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqlpg\" (UniqueName: \"kubernetes.io/projected/84047bd1-10d9-4440-9006-adf9505edb94-kube-api-access-zqlpg\") pod \"maas-controller-6bbb8c8848-w5p5n\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") " pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.338787 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.338754    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:16.477298 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.477256    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-w5p5n"]
Jul 08 20:10:16.479479 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:10:16.479449    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84047bd1_10d9_4440_9006_adf9505edb94.slice/crio-849118be5ff4248d9dd27d6d43ee53c6febe46be1a6a145575538fe0439edc1f WatchSource:0}: Error finding container 849118be5ff4248d9dd27d6d43ee53c6febe46be1a6a145575538fe0439edc1f: Status 404 returned error can't find the container with id 849118be5ff4248d9dd27d6d43ee53c6febe46be1a6a145575538fe0439edc1f
Jul 08 20:10:16.799834 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:16.799747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n" event={"ID":"84047bd1-10d9-4440-9006-adf9505edb94","Type":"ContainerStarted","Data":"849118be5ff4248d9dd27d6d43ee53c6febe46be1a6a145575538fe0439edc1f"}
Jul 08 20:10:18.810696 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:18.810662    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n" event={"ID":"84047bd1-10d9-4440-9006-adf9505edb94","Type":"ContainerStarted","Data":"3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652"}
Jul 08 20:10:18.811026 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:18.810758    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:18.851580 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:18.851527    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n" podStartSLOduration=0.669751561 podStartE2EDuration="2.851509157s" totalImagesPullingTime="2.181757596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:10:18.85065965 +0000 UTC m=+625.061666276" watchObservedRunningTime="2026-07-08 20:10:18.851509157 +0000 UTC m=+625.062515783"
Jul 08 20:10:29.821887 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:29.821854    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:10:49.696644 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.696601    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"]
Jul 08 20:10:49.699976 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.699956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.703471 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.703435    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x22jf\""
Jul 08 20:10:49.703471 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.703466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 20:10:49.727710 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.727670    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"]
Jul 08 20:10:49.788790 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.788757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76mfx\" (UniqueName: \"kubernetes.io/projected/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-kube-api-access-76mfx\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.788983 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.788896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-openshift-service-ca\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.789033 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.788984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-maas-api-tls\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.890372 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.890339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-openshift-service-ca\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.890552 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.890385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-maas-api-tls\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.890552 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.890433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76mfx\" (UniqueName: \"kubernetes.io/projected/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-kube-api-access-76mfx\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.890650 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:10:49.890551    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 20:10:49.890650 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:10:49.890622    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-maas-api-tls podName:3d28dcad-e7a6-4090-bfe3-fa81a6b65f14 nodeName:}" failed. No retries permitted until 2026-07-08 20:10:50.390600032 +0000 UTC m=+656.601606640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-maas-api-tls") pod "maas-api-846554cbbc-dzgpf" (UID: "3d28dcad-e7a6-4090-bfe3-fa81a6b65f14") : secret "maas-api-serving-cert" not found
Jul 08 20:10:49.891012 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.890992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-openshift-service-ca\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:49.907501 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:49.907468    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76mfx\" (UniqueName: \"kubernetes.io/projected/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-kube-api-access-76mfx\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:50.378636 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.378600    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dfd4t"]
Jul 08 20:10:50.382111 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.382092    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.384852 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.384834    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 20:10:50.395198 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.395173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-maas-api-tls\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:50.395910 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.395889    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dfd4t"]
Jul 08 20:10:50.397682 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.397663    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d28dcad-e7a6-4090-bfe3-fa81a6b65f14-maas-api-tls\") pod \"maas-api-846554cbbc-dzgpf\" (UID: \"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14\") " pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:50.495957 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.495921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh5xn\" (UniqueName: \"kubernetes.io/projected/c5e09a59-d18a-4663-a267-a62f788c5a14-kube-api-access-rh5xn\") pod \"payload-processing-58f86c7798-dfd4t\" (UID: \"c5e09a59-d18a-4663-a267-a62f788c5a14\") " pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.496129 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.495966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e09a59-d18a-4663-a267-a62f788c5a14-plugins-config-volume\") pod \"payload-processing-58f86c7798-dfd4t\" (UID: \"c5e09a59-d18a-4663-a267-a62f788c5a14\") " pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.597169 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.597124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh5xn\" (UniqueName: \"kubernetes.io/projected/c5e09a59-d18a-4663-a267-a62f788c5a14-kube-api-access-rh5xn\") pod \"payload-processing-58f86c7798-dfd4t\" (UID: \"c5e09a59-d18a-4663-a267-a62f788c5a14\") " pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.597363 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.597176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e09a59-d18a-4663-a267-a62f788c5a14-plugins-config-volume\") pod \"payload-processing-58f86c7798-dfd4t\" (UID: \"c5e09a59-d18a-4663-a267-a62f788c5a14\") " pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.597956 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.597936    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e09a59-d18a-4663-a267-a62f788c5a14-plugins-config-volume\") pod \"payload-processing-58f86c7798-dfd4t\" (UID: \"c5e09a59-d18a-4663-a267-a62f788c5a14\") " pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.611090 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.611053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:50.620973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.620936    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh5xn\" (UniqueName: \"kubernetes.io/projected/c5e09a59-d18a-4663-a267-a62f788c5a14-kube-api-access-rh5xn\") pod \"payload-processing-58f86c7798-dfd4t\" (UID: \"c5e09a59-d18a-4663-a267-a62f788c5a14\") " pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.693310 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.693275    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:50.768789 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.768706    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"]
Jul 08 20:10:50.771232 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:10:50.771195    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d28dcad_e7a6_4090_bfe3_fa81a6b65f14.slice/crio-61cc9ea05bc129a6db5d384b4fe98dbd06570901759fd177344bd485162ee5c3 WatchSource:0}: Error finding container 61cc9ea05bc129a6db5d384b4fe98dbd06570901759fd177344bd485162ee5c3: Status 404 returned error can't find the container with id 61cc9ea05bc129a6db5d384b4fe98dbd06570901759fd177344bd485162ee5c3
Jul 08 20:10:50.861835 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.861803    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dfd4t"]
Jul 08 20:10:50.865310 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:10:50.865269    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e09a59_d18a_4663_a267_a62f788c5a14.slice/crio-3beb31399298e6440a5fb41cb3ec1dc49c77319913d33b0cf6f8e836b0091623 WatchSource:0}: Error finding container 3beb31399298e6440a5fb41cb3ec1dc49c77319913d33b0cf6f8e836b0091623: Status 404 returned error can't find the container with id 3beb31399298e6440a5fb41cb3ec1dc49c77319913d33b0cf6f8e836b0091623
Jul 08 20:10:50.953606 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.953504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t" event={"ID":"c5e09a59-d18a-4663-a267-a62f788c5a14","Type":"ContainerStarted","Data":"3beb31399298e6440a5fb41cb3ec1dc49c77319913d33b0cf6f8e836b0091623"}
Jul 08 20:10:50.954754 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:50.954718    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf" event={"ID":"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14","Type":"ContainerStarted","Data":"61cc9ea05bc129a6db5d384b4fe98dbd06570901759fd177344bd485162ee5c3"}
Jul 08 20:10:52.969433 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:52.969341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t" event={"ID":"c5e09a59-d18a-4663-a267-a62f788c5a14","Type":"ContainerStarted","Data":"3b8ef976b2ac650bd4fa2e538f89f0c62ee62bd90ec299d671aad95cd92342ce"}
Jul 08 20:10:52.969890 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:52.969535    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:10:52.988219 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:52.988105    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t" podStartSLOduration=1.241353801 podStartE2EDuration="2.988085836s" totalImagesPullingTime="1.746732035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:10:52.987752894 +0000 UTC m=+659.198759532" watchObservedRunningTime="2026-07-08 20:10:52.988085836 +0000 UTC m=+659.199092459"
Jul 08 20:10:53.975850 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:53.975812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf" event={"ID":"3d28dcad-e7a6-4090-bfe3-fa81a6b65f14","Type":"ContainerStarted","Data":"3f518a7c07c44c9408340b75c0a19f1da75cceee5ab56fc1d0c1a00a20cb6bf1"}
Jul 08 20:10:53.976289 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:53.976082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:10:54.014159 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:54.014096    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf" podStartSLOduration=2.345344199 podStartE2EDuration="5.014078559s" totalImagesPullingTime="2.66873436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:10:54.011237647 +0000 UTC m=+660.222244274" watchObservedRunningTime="2026-07-08 20:10:54.014078559 +0000 UTC m=+660.225085185"
Jul 08 20:10:57.997445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:57.997341    2582 generic.go:356] "Generic (PLEG): container finished" podID="95b0d3dc-2826-4cf0-96e6-e17ad5549b67" containerID="31e33d6ade110e2741277baee654a29ab2bf183fddf0dbf54b5ac32171f211ba" exitCode=0
Jul 08 20:10:57.997445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:57.997422    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" event={"ID":"95b0d3dc-2826-4cf0-96e6-e17ad5549b67","Type":"ContainerDied","Data":"31e33d6ade110e2741277baee654a29ab2bf183fddf0dbf54b5ac32171f211ba"}
Jul 08 20:10:57.997888 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:57.997867    2582 scope.go:117] "RemoveContainer" containerID="31e33d6ade110e2741277baee654a29ab2bf183fddf0dbf54b5ac32171f211ba"
Jul 08 20:10:57.998974 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:57.998940    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:10:57.999031 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:57.999013    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:10:57.999076 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:57.999062    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:10:59.004283 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:59.004245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" event={"ID":"95b0d3dc-2826-4cf0-96e6-e17ad5549b67","Type":"ContainerStarted","Data":"b2775ab6f20c003836e056ed145b7896f205fc551dcd854b7b76aca73578cf11"}
Jul 08 20:10:59.132808 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:59.132760    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:10:59.133513 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:59.133480    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-57jjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 08 20:10:59.133661 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:59.133541    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" podUID="95b0d3dc-2826-4cf0-96e6-e17ad5549b67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 08 20:10:59.985954 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:10:59.985923    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-846554cbbc-dzgpf"
Jul 08 20:11:00.132768 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:00.132729    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-57jjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 08 20:11:00.133353 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:00.133297    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" podUID="95b0d3dc-2826-4cf0-96e6-e17ad5549b67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 08 20:11:01.132592 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:01.132541    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-57jjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 08 20:11:01.132814 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:01.132615    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" podUID="95b0d3dc-2826-4cf0-96e6-e17ad5549b67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 08 20:11:02.131873 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:02.131830    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-57jjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 08 20:11:02.132166 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:02.132133    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm" podUID="95b0d3dc-2826-4cf0-96e6-e17ad5549b67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 08 20:11:02.565283 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:02.565241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:11:03.135624 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:03.135591    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:11:03.136757 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:03.136736    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-57jjm"
Jul 08 20:11:03.977691 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:03.977654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-dfd4t"
Jul 08 20:11:29.990610 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:29.990576    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"]
Jul 08 20:11:29.995394 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:29.995375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:29.998382 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:29.998352    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 20:11:29.998505 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:29.998426    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 20:11:29.999468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:29.999446    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 20:11:29.999580 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:29.999498    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l89df\""
Jul 08 20:11:30.003818 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.003786    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"]
Jul 08 20:11:30.066774 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.066739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.066938 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.066796    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbth\" (UniqueName: \"kubernetes.io/projected/48e04edf-ee1d-4d72-a6e9-4eab893473c6-kube-api-access-9tbth\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.066938 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.066847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.066938 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.066883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48e04edf-ee1d-4d72-a6e9-4eab893473c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.066938 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.066904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.066938 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.066936    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168306 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168492 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbth\" (UniqueName: \"kubernetes.io/projected/48e04edf-ee1d-4d72-a6e9-4eab893473c6-kube-api-access-9tbth\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168492 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168492 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48e04edf-ee1d-4d72-a6e9-4eab893473c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168596 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168640 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168757 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168737    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.168922 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168897    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.169038 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.168929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.171269 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.171241    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48e04edf-ee1d-4d72-a6e9-4eab893473c6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.171534 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.171515    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48e04edf-ee1d-4d72-a6e9-4eab893473c6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.177627 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.177605    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbth\" (UniqueName: \"kubernetes.io/projected/48e04edf-ee1d-4d72-a6e9-4eab893473c6-kube-api-access-9tbth\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7gzjf\" (UID: \"48e04edf-ee1d-4d72-a6e9-4eab893473c6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.306798 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.306703    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:30.447130 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.447098    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"]
Jul 08 20:11:30.452711 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:30.452690    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 20:11:31.166837 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:31.166803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf" event={"ID":"48e04edf-ee1d-4d72-a6e9-4eab893473c6","Type":"ContainerStarted","Data":"37f230ce75e57cb2247556b56aadbe509fb895b3e0aaee45886869f41f51176d"}
Jul 08 20:11:32.172838 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:32.172795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf" event={"ID":"48e04edf-ee1d-4d72-a6e9-4eab893473c6","Type":"ContainerStarted","Data":"86810f3ad27a1167a741497a793b3d033539b0fade5119cf2e076cbad4490d2b"}
Jul 08 20:11:32.193025 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:32.192979    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf" podStartSLOduration=2.019218406 podStartE2EDuration="3.19296335s" totalImagesPullingTime="1.173744944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:11:32.191067001 +0000 UTC m=+698.402073627" watchObservedRunningTime="2026-07-08 20:11:32.19296335 +0000 UTC m=+698.403969976"
Jul 08 20:11:40.307768 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:40.307731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:40.308152 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:40.307799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:40.322935 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:40.322904    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:11:41.229618 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:11:41.229573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7gzjf"
Jul 08 20:13:33.567379 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.567284    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-864dfc7576-qcdzh"]
Jul 08 20:13:33.570665 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.570647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.579404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.579350    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-864dfc7576-qcdzh"]
Jul 08 20:13:33.635715 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.635674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/362120d3-18a1-4885-bc0d-125908ce2ba5-tls-cert\") pod \"authorino-864dfc7576-qcdzh\" (UID: \"362120d3-18a1-4885-bc0d-125908ce2ba5\") " pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.635715 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.635717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2bgq\" (UniqueName: \"kubernetes.io/projected/362120d3-18a1-4885-bc0d-125908ce2ba5-kube-api-access-s2bgq\") pod \"authorino-864dfc7576-qcdzh\" (UID: \"362120d3-18a1-4885-bc0d-125908ce2ba5\") " pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.736906 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.736862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/362120d3-18a1-4885-bc0d-125908ce2ba5-tls-cert\") pod \"authorino-864dfc7576-qcdzh\" (UID: \"362120d3-18a1-4885-bc0d-125908ce2ba5\") " pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.736906 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.736902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2bgq\" (UniqueName: \"kubernetes.io/projected/362120d3-18a1-4885-bc0d-125908ce2ba5-kube-api-access-s2bgq\") pod \"authorino-864dfc7576-qcdzh\" (UID: \"362120d3-18a1-4885-bc0d-125908ce2ba5\") " pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.739309 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.739285    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/362120d3-18a1-4885-bc0d-125908ce2ba5-tls-cert\") pod \"authorino-864dfc7576-qcdzh\" (UID: \"362120d3-18a1-4885-bc0d-125908ce2ba5\") " pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.747692 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.747666    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2bgq\" (UniqueName: \"kubernetes.io/projected/362120d3-18a1-4885-bc0d-125908ce2ba5-kube-api-access-s2bgq\") pod \"authorino-864dfc7576-qcdzh\" (UID: \"362120d3-18a1-4885-bc0d-125908ce2ba5\") " pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:33.880614 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:33.880523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-864dfc7576-qcdzh"
Jul 08 20:13:34.015523 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:34.015496    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-864dfc7576-qcdzh"]
Jul 08 20:13:34.018011 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:13:34.017980    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod362120d3_18a1_4885_bc0d_125908ce2ba5.slice/crio-b378aed0c36d0d967f69f16c9b9280fc5832c8014c6d8ec4c85be7fce47619f2 WatchSource:0}: Error finding container b378aed0c36d0d967f69f16c9b9280fc5832c8014c6d8ec4c85be7fce47619f2: Status 404 returned error can't find the container with id b378aed0c36d0d967f69f16c9b9280fc5832c8014c6d8ec4c85be7fce47619f2
Jul 08 20:13:34.744119 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:34.743191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-864dfc7576-qcdzh" event={"ID":"362120d3-18a1-4885-bc0d-125908ce2ba5","Type":"ContainerStarted","Data":"379d637275f735fd2094a358288dd04451e637c9acce0d0c7f0e3368e8a2fcc5"}
Jul 08 20:13:34.744119 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:34.743268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-864dfc7576-qcdzh" event={"ID":"362120d3-18a1-4885-bc0d-125908ce2ba5","Type":"ContainerStarted","Data":"b378aed0c36d0d967f69f16c9b9280fc5832c8014c6d8ec4c85be7fce47619f2"}
Jul 08 20:13:34.769550 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:34.769409    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-864dfc7576-qcdzh" podStartSLOduration=1.290291085 podStartE2EDuration="1.769384946s" totalImagesPullingTime="479.093861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:13:34.767242574 +0000 UTC m=+820.978249194" watchObservedRunningTime="2026-07-08 20:13:34.769384946 +0000 UTC m=+820.980391633"
Jul 08 20:13:34.808340 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:34.805407    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b6ff94d9-4vxhg"]
Jul 08 20:13:34.808340 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:34.805613    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg" podUID="e7056693-38cf-49ac-9531-3d177c63e144" containerName="authorino" containerID="cri-o://199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a" gracePeriod=30
Jul 08 20:13:35.079480 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.079453    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:13:35.148630 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.148593    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tspmv\" (UniqueName: \"kubernetes.io/projected/e7056693-38cf-49ac-9531-3d177c63e144-kube-api-access-tspmv\") pod \"e7056693-38cf-49ac-9531-3d177c63e144\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") "
Jul 08 20:13:35.149366 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.149341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7056693-38cf-49ac-9531-3d177c63e144-tls-cert\") pod \"e7056693-38cf-49ac-9531-3d177c63e144\" (UID: \"e7056693-38cf-49ac-9531-3d177c63e144\") "
Jul 08 20:13:35.154058 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.154001    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7056693-38cf-49ac-9531-3d177c63e144-kube-api-access-tspmv" (OuterVolumeSpecName: "kube-api-access-tspmv") pod "e7056693-38cf-49ac-9531-3d177c63e144" (UID: "e7056693-38cf-49ac-9531-3d177c63e144"). InnerVolumeSpecName "kube-api-access-tspmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:13:35.163306 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.163272    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7056693-38cf-49ac-9531-3d177c63e144-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e7056693-38cf-49ac-9531-3d177c63e144" (UID: "e7056693-38cf-49ac-9531-3d177c63e144"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:13:35.250774 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.250739    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7056693-38cf-49ac-9531-3d177c63e144-tls-cert\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:13:35.250774 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.250772    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tspmv\" (UniqueName: \"kubernetes.io/projected/e7056693-38cf-49ac-9531-3d177c63e144-kube-api-access-tspmv\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:13:35.750824 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.750790    2582 generic.go:356] "Generic (PLEG): container finished" podID="e7056693-38cf-49ac-9531-3d177c63e144" containerID="199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a" exitCode=0
Jul 08 20:13:35.751259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.750840    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg"
Jul 08 20:13:35.751259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.750876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg" event={"ID":"e7056693-38cf-49ac-9531-3d177c63e144","Type":"ContainerDied","Data":"199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a"}
Jul 08 20:13:35.751259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.750928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75b6ff94d9-4vxhg" event={"ID":"e7056693-38cf-49ac-9531-3d177c63e144","Type":"ContainerDied","Data":"a41ad1f724cba7a8fba57dca2f1d6dd374686db9e297e567cfc982e6c1ba1cc8"}
Jul 08 20:13:35.751259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.750954    2582 scope.go:117] "RemoveContainer" containerID="199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a"
Jul 08 20:13:35.761151 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.761115    2582 scope.go:117] "RemoveContainer" containerID="199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a"
Jul 08 20:13:35.761548 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:13:35.761522    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a\": container with ID starting with 199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a not found: ID does not exist" containerID="199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a"
Jul 08 20:13:35.761655 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.761557    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a"} err="failed to get container status \"199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a\": rpc error: code = NotFound desc = could not find container \"199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a\": container with ID starting with 199f003829ac12384c2f47ae45fe14d23f96227acb4e1af26bcb78e169971b6a not found: ID does not exist"
Jul 08 20:13:35.775202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.775167    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75b6ff94d9-4vxhg"]
Jul 08 20:13:35.782709 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:35.782678    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75b6ff94d9-4vxhg"]
Jul 08 20:13:36.317725 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:13:36.317691    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7056693-38cf-49ac-9531-3d177c63e144" path="/var/lib/kubelet/pods/e7056693-38cf-49ac-9531-3d177c63e144/volumes"
Jul 08 20:14:49.257282 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.257174    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-w5p5n"]
Jul 08 20:14:49.257880 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.257463    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n" podUID="84047bd1-10d9-4440-9006-adf9505edb94" containerName="manager" containerID="cri-o://3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652" gracePeriod=30
Jul 08 20:14:49.505057 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.505031    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:14:49.592996 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.592959    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqlpg\" (UniqueName: \"kubernetes.io/projected/84047bd1-10d9-4440-9006-adf9505edb94-kube-api-access-zqlpg\") pod \"84047bd1-10d9-4440-9006-adf9505edb94\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") "
Jul 08 20:14:49.593173 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.593039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84047bd1-10d9-4440-9006-adf9505edb94-webhook-cert\") pod \"84047bd1-10d9-4440-9006-adf9505edb94\" (UID: \"84047bd1-10d9-4440-9006-adf9505edb94\") "
Jul 08 20:14:49.595226 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.595195    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84047bd1-10d9-4440-9006-adf9505edb94-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "84047bd1-10d9-4440-9006-adf9505edb94" (UID: "84047bd1-10d9-4440-9006-adf9505edb94"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:14:49.595349 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.595222    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84047bd1-10d9-4440-9006-adf9505edb94-kube-api-access-zqlpg" (OuterVolumeSpecName: "kube-api-access-zqlpg") pod "84047bd1-10d9-4440-9006-adf9505edb94" (UID: "84047bd1-10d9-4440-9006-adf9505edb94"). InnerVolumeSpecName "kube-api-access-zqlpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:14:49.694359 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.694304    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/84047bd1-10d9-4440-9006-adf9505edb94-webhook-cert\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:14:49.694359 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:49.694353    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqlpg\" (UniqueName: \"kubernetes.io/projected/84047bd1-10d9-4440-9006-adf9505edb94-kube-api-access-zqlpg\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:14:50.096300 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.096264    2582 generic.go:356] "Generic (PLEG): container finished" podID="84047bd1-10d9-4440-9006-adf9505edb94" containerID="3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652" exitCode=0
Jul 08 20:14:50.096474 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.096309    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n"
Jul 08 20:14:50.096474 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.096353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n" event={"ID":"84047bd1-10d9-4440-9006-adf9505edb94","Type":"ContainerDied","Data":"3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652"}
Jul 08 20:14:50.096474 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.096413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bbb8c8848-w5p5n" event={"ID":"84047bd1-10d9-4440-9006-adf9505edb94","Type":"ContainerDied","Data":"849118be5ff4248d9dd27d6d43ee53c6febe46be1a6a145575538fe0439edc1f"}
Jul 08 20:14:50.096474 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.096441    2582 scope.go:117] "RemoveContainer" containerID="3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652"
Jul 08 20:14:50.106794 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.106724    2582 scope.go:117] "RemoveContainer" containerID="3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652"
Jul 08 20:14:50.108404 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:14:50.107644    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652\": container with ID starting with 3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652 not found: ID does not exist" containerID="3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652"
Jul 08 20:14:50.108404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.107688    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652"} err="failed to get container status \"3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652\": rpc error: code = NotFound desc = could not find container \"3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652\": container with ID starting with 3760613c5b8b3559e11ecda1113ee9533898c0ede5e5e6cabd13e317d8dd8652 not found: ID does not exist"
Jul 08 20:14:50.124170 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.124136    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-w5p5n"]
Jul 08 20:14:50.128925 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.128895    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-w5p5n"]
Jul 08 20:14:50.317469 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.317434    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84047bd1-10d9-4440-9006-adf9505edb94" path="/var/lib/kubelet/pods/84047bd1-10d9-4440-9006-adf9505edb94/volumes"
Jul 08 20:14:50.988170 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988137    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-4dhnp"]
Jul 08 20:14:50.988519 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988506    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7056693-38cf-49ac-9531-3d177c63e144" containerName="authorino"
Jul 08 20:14:50.988519 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988521    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7056693-38cf-49ac-9531-3d177c63e144" containerName="authorino"
Jul 08 20:14:50.988646 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988538    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84047bd1-10d9-4440-9006-adf9505edb94" containerName="manager"
Jul 08 20:14:50.988646 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988544    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="84047bd1-10d9-4440-9006-adf9505edb94" containerName="manager"
Jul 08 20:14:50.988646 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988600    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7056693-38cf-49ac-9531-3d177c63e144" containerName="authorino"
Jul 08 20:14:50.988646 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.988608    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="84047bd1-10d9-4440-9006-adf9505edb94" containerName="manager"
Jul 08 20:14:50.991675 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.991653    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:50.995798 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.995778    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 20:14:50.995893 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.995777    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 20:14:50.996805 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:50.996791    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-p5v28\""
Jul 08 20:14:51.005570 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.005543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg845\" (UniqueName: \"kubernetes.io/projected/8bb2eea7-8292-4b85-8718-49aa801b3dee-kube-api-access-rg845\") pod \"maas-controller-6bbb8c8848-4dhnp\" (UID: \"8bb2eea7-8292-4b85-8718-49aa801b3dee\") " pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.005689 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.005577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bb2eea7-8292-4b85-8718-49aa801b3dee-webhook-cert\") pod \"maas-controller-6bbb8c8848-4dhnp\" (UID: \"8bb2eea7-8292-4b85-8718-49aa801b3dee\") " pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.009445 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.009419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-4dhnp"]
Jul 08 20:14:51.106803 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.106773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg845\" (UniqueName: \"kubernetes.io/projected/8bb2eea7-8292-4b85-8718-49aa801b3dee-kube-api-access-rg845\") pod \"maas-controller-6bbb8c8848-4dhnp\" (UID: \"8bb2eea7-8292-4b85-8718-49aa801b3dee\") " pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.106803 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.106808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bb2eea7-8292-4b85-8718-49aa801b3dee-webhook-cert\") pod \"maas-controller-6bbb8c8848-4dhnp\" (UID: \"8bb2eea7-8292-4b85-8718-49aa801b3dee\") " pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.109290 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.109263    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8bb2eea7-8292-4b85-8718-49aa801b3dee-webhook-cert\") pod \"maas-controller-6bbb8c8848-4dhnp\" (UID: \"8bb2eea7-8292-4b85-8718-49aa801b3dee\") " pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.116599 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.116570    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg845\" (UniqueName: \"kubernetes.io/projected/8bb2eea7-8292-4b85-8718-49aa801b3dee-kube-api-access-rg845\") pod \"maas-controller-6bbb8c8848-4dhnp\" (UID: \"8bb2eea7-8292-4b85-8718-49aa801b3dee\") " pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.302035 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.301938    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:51.438985 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:51.438942    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bbb8c8848-4dhnp"]
Jul 08 20:14:51.441304 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:14:51.441278    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb2eea7_8292_4b85_8718_49aa801b3dee.slice/crio-9100f5f1699fb0a85797847ccf72eca61feef49fbbee0990d25d2a306f6eebd6 WatchSource:0}: Error finding container 9100f5f1699fb0a85797847ccf72eca61feef49fbbee0990d25d2a306f6eebd6: Status 404 returned error can't find the container with id 9100f5f1699fb0a85797847ccf72eca61feef49fbbee0990d25d2a306f6eebd6
Jul 08 20:14:52.109476 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:52.109439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp" event={"ID":"8bb2eea7-8292-4b85-8718-49aa801b3dee","Type":"ContainerStarted","Data":"f2092c3a507a42a4191b3e3549a89038a11d81287275b05b9986825580bc9fe6"}
Jul 08 20:14:52.109659 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:52.109497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp" event={"ID":"8bb2eea7-8292-4b85-8718-49aa801b3dee","Type":"ContainerStarted","Data":"9100f5f1699fb0a85797847ccf72eca61feef49fbbee0990d25d2a306f6eebd6"}
Jul 08 20:14:52.109659 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:52.109526    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:14:52.126036 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:14:52.125963    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp" podStartSLOduration=1.551983174 podStartE2EDuration="2.125940476s" totalImagesPullingTime="573.957302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:14:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:14:52.124906499 +0000 UTC m=+898.335913151" watchObservedRunningTime="2026-07-08 20:14:52.125940476 +0000 UTC m=+898.336947105"
Jul 08 20:15:00.145759 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.145725    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"]
Jul 08 20:15:00.150288 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.150270    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:15:00.157023 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.156989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"]
Jul 08 20:15:00.186554 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.186486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjsn\" (UniqueName: \"kubernetes.io/projected/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e-kube-api-access-pvjsn\") pod \"maas-api-key-cleanup-29725695-p9bq6\" (UID: \"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:15:00.287100 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.287057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjsn\" (UniqueName: \"kubernetes.io/projected/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e-kube-api-access-pvjsn\") pod \"maas-api-key-cleanup-29725695-p9bq6\" (UID: \"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:15:00.295636 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.295603    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjsn\" (UniqueName: \"kubernetes.io/projected/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e-kube-api-access-pvjsn\") pod \"maas-api-key-cleanup-29725695-p9bq6\" (UID: \"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:15:00.463649 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.463556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:15:00.597186 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:00.597158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"]
Jul 08 20:15:00.599437 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:15:00.599409    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4fb610a_17f0_4dc1_bf79_dfc4f953e68e.slice/crio-2df72ae89fe86b49edbd5e5ab6d6aeaf8043d0a8951699a6bc9b9b53492f74a7 WatchSource:0}: Error finding container 2df72ae89fe86b49edbd5e5ab6d6aeaf8043d0a8951699a6bc9b9b53492f74a7: Status 404 returned error can't find the container with id 2df72ae89fe86b49edbd5e5ab6d6aeaf8043d0a8951699a6bc9b9b53492f74a7
Jul 08 20:15:01.152434 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:01.152395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6" event={"ID":"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e","Type":"ContainerStarted","Data":"2df72ae89fe86b49edbd5e5ab6d6aeaf8043d0a8951699a6bc9b9b53492f74a7"}
Jul 08 20:15:03.121149 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:03.121122    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bbb8c8848-4dhnp"
Jul 08 20:15:03.164727 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:03.164688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6" event={"ID":"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e","Type":"ContainerStarted","Data":"1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d"}
Jul 08 20:15:03.180268 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:15:03.180215    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6" podStartSLOduration=0.943524255 podStartE2EDuration="3.180198162s" totalImagesPullingTime="2.236673907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:15:03.179005923 +0000 UTC m=+909.390012550" watchObservedRunningTime="2026-07-08 20:15:03.180198162 +0000 UTC m=+909.391204821"
Jul 08 20:16:00.011157 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:00.011117    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"]
Jul 08 20:16:00.013478 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:00.011356    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6" podUID="e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" containerName="cleanup" containerID="cri-o://1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d" gracePeriod=30
Jul 08 20:16:30.217889 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.217847    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:16:30.274235 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.274149    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvjsn\" (UniqueName: \"kubernetes.io/projected/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e-kube-api-access-pvjsn\") pod \"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e\" (UID: \"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e\") "
Jul 08 20:16:30.276390 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.276356    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e-kube-api-access-pvjsn" (OuterVolumeSpecName: "kube-api-access-pvjsn") pod "e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" (UID: "e4fb610a-17f0-4dc1-bf79-dfc4f953e68e"). InnerVolumeSpecName "kube-api-access-pvjsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:16:30.375369 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.375306    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvjsn\" (UniqueName: \"kubernetes.io/projected/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e-kube-api-access-pvjsn\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:16:30.576840 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.576804    2582 generic.go:356] "Generic (PLEG): container finished" podID="e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" containerID="1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d" exitCode=137
Jul 08 20:16:30.577025 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.576847    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"
Jul 08 20:16:30.577025 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.576896    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6" event={"ID":"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e","Type":"ContainerDied","Data":"1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d"}
Jul 08 20:16:30.577025 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.576950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6" event={"ID":"e4fb610a-17f0-4dc1-bf79-dfc4f953e68e","Type":"ContainerDied","Data":"2df72ae89fe86b49edbd5e5ab6d6aeaf8043d0a8951699a6bc9b9b53492f74a7"}
Jul 08 20:16:30.577025 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.576973    2582 scope.go:117] "RemoveContainer" containerID="1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d"
Jul 08 20:16:30.586867 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.586847    2582 scope.go:117] "RemoveContainer" containerID="1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d"
Jul 08 20:16:30.587189 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:16:30.587168    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d\": container with ID starting with 1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d not found: ID does not exist" containerID="1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d"
Jul 08 20:16:30.587295 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.587195    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d"} err="failed to get container status \"1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d\": rpc error: code = NotFound desc = could not find container \"1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d\": container with ID starting with 1323e0d8c72fc4556ebb14d9b5e524a40a90c3bfcc92973b8ce58f263fbb2c4d not found: ID does not exist"
Jul 08 20:16:30.599788 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.599292    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"]
Jul 08 20:16:30.599788 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:30.599369    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725695-p9bq6"]
Jul 08 20:16:32.317101 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:16:32.317068    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" path="/var/lib/kubelet/pods/e4fb610a-17f0-4dc1-bf79-dfc4f953e68e/volumes"
Jul 08 20:20:37.015752 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.015714    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"]
Jul 08 20:20:37.016240 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.016102    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" containerName="cleanup"
Jul 08 20:20:37.016240 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.016115    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" containerName="cleanup"
Jul 08 20:20:37.016240 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.016177    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4fb610a-17f0-4dc1-bf79-dfc4f953e68e" containerName="cleanup"
Jul 08 20:20:37.019176 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.019155    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.022242 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.022222    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hhfqt\""
Jul 08 20:20:37.032418 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.032386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"]
Jul 08 20:20:37.148722 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.148681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/237991a3-fd57-461b-bca5-1f4ac3fe2e88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cqtqm\" (UID: \"237991a3-fd57-461b-bca5-1f4ac3fe2e88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.148722 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.148723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vsl\" (UniqueName: \"kubernetes.io/projected/237991a3-fd57-461b-bca5-1f4ac3fe2e88-kube-api-access-j5vsl\") pod \"kuadrant-operator-controller-manager-86878c769f-cqtqm\" (UID: \"237991a3-fd57-461b-bca5-1f4ac3fe2e88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.249404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.249347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/237991a3-fd57-461b-bca5-1f4ac3fe2e88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cqtqm\" (UID: \"237991a3-fd57-461b-bca5-1f4ac3fe2e88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.249404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.249404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vsl\" (UniqueName: \"kubernetes.io/projected/237991a3-fd57-461b-bca5-1f4ac3fe2e88-kube-api-access-j5vsl\") pod \"kuadrant-operator-controller-manager-86878c769f-cqtqm\" (UID: \"237991a3-fd57-461b-bca5-1f4ac3fe2e88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.249734 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.249714    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/237991a3-fd57-461b-bca5-1f4ac3fe2e88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cqtqm\" (UID: \"237991a3-fd57-461b-bca5-1f4ac3fe2e88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.258520 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.258493    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vsl\" (UniqueName: \"kubernetes.io/projected/237991a3-fd57-461b-bca5-1f4ac3fe2e88-kube-api-access-j5vsl\") pod \"kuadrant-operator-controller-manager-86878c769f-cqtqm\" (UID: \"237991a3-fd57-461b-bca5-1f4ac3fe2e88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.329687 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.329644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.470757 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.470730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"]
Jul 08 20:20:37.472968 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:20:37.472939    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237991a3_fd57_461b_bca5_1f4ac3fe2e88.slice/crio-f1db6c23b83c4a32f293d882e7b034f58775f64c712e412d1e371ff05fea74e6 WatchSource:0}: Error finding container f1db6c23b83c4a32f293d882e7b034f58775f64c712e412d1e371ff05fea74e6: Status 404 returned error can't find the container with id f1db6c23b83c4a32f293d882e7b034f58775f64c712e412d1e371ff05fea74e6
Jul 08 20:20:37.745296 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.745194    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm" event={"ID":"237991a3-fd57-461b-bca5-1f4ac3fe2e88","Type":"ContainerStarted","Data":"1119801270a71b0fbb24f00abe27ac50edc236e9ab7f6c70c6ce6148b384a147"}
Jul 08 20:20:37.745296 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.745269    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:20:37.745296 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.745292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm" event={"ID":"237991a3-fd57-461b-bca5-1f4ac3fe2e88","Type":"ContainerStarted","Data":"f1db6c23b83c4a32f293d882e7b034f58775f64c712e412d1e371ff05fea74e6"}
Jul 08 20:20:37.766221 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:37.766162    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm" podStartSLOduration=1.766145665 podStartE2EDuration="1.766145665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:20:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:20:37.763929182 +0000 UTC m=+1243.974935808" watchObservedRunningTime="2026-07-08 20:20:37.766145665 +0000 UTC m=+1243.977152291"
Jul 08 20:20:48.752840 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:20:48.752754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cqtqm"
Jul 08 20:27:14.530242 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.530207    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"]
Jul 08 20:27:14.534336 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.534294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.537420 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.537397    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bb4eb1cc-openshift-default-dockercfg-2w6d4\""
Jul 08 20:27:14.546632 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.546601    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"]
Jul 08 20:27:14.574288 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5940fb3f-d997-4302-b35d-093be668b9e7-istiod-ca-cert\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574622 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-credential-socket\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-envoy\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5940fb3f-d997-4302-b35d-093be668b9e7-istio-podinfo\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-istio-token\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574929 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7sp8\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-kube-api-access-x7sp8\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574929 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-socket\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574929 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-certs\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.574929 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.574911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-data\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.675651 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5940fb3f-d997-4302-b35d-093be668b9e7-istiod-ca-cert\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.675854 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-credential-socket\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.675854 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-envoy\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.675854 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5940fb3f-d997-4302-b35d-093be668b9e7-istio-podinfo\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.675854 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-istio-token\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.675854 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7sp8\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-kube-api-access-x7sp8\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676155 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-socket\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676155 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-certs\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676155 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.675932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-data\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676155 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.676084    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-credential-socket\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676397 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.676332    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-data\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676471 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.676447    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5940fb3f-d997-4302-b35d-093be668b9e7-istiod-ca-cert\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676631 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.676609    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-certs\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.676703 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.676683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-socket\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.678139 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.678114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-envoy\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.678440 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.678418    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5940fb3f-d997-4302-b35d-093be668b9e7-istio-podinfo\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.685094 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.685072    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-istio-token\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.685251 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.685234    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7sp8\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-kube-api-access-x7sp8\") pod \"e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") " pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.846535 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.846496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:14.989557 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.989531    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"]
Jul 08 20:27:14.992267 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:27:14.992231    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5940fb3f_d997_4302_b35d_093be668b9e7.slice/crio-942a84a9dd49088e82057627acdb712c5fc532d0668d219b3af3498470aa2a7a WatchSource:0}: Error finding container 942a84a9dd49088e82057627acdb712c5fc532d0668d219b3af3498470aa2a7a: Status 404 returned error can't find the container with id 942a84a9dd49088e82057627acdb712c5fc532d0668d219b3af3498470aa2a7a
Jul 08 20:27:14.994286 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.994250    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:27:14.994392 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.994338    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:27:14.994392 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:14.994367    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:27:15.690663 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:15.690629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" event={"ID":"5940fb3f-d997-4302-b35d-093be668b9e7","Type":"ContainerStarted","Data":"b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"}
Jul 08 20:27:15.691107 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:15.690688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" event={"ID":"5940fb3f-d997-4302-b35d-093be668b9e7","Type":"ContainerStarted","Data":"942a84a9dd49088e82057627acdb712c5fc532d0668d219b3af3498470aa2a7a"}
Jul 08 20:27:15.714651 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:15.714586    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" podStartSLOduration=1.71456534 podStartE2EDuration="1.71456534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:27:15.712256192 +0000 UTC m=+1641.923262833" watchObservedRunningTime="2026-07-08 20:27:15.71456534 +0000 UTC m=+1641.925571967"
Jul 08 20:27:15.847328 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:15.847287    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:16.852409 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:16.852376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:17.700403 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:17.700373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:17.701241 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:17.701223    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:26.751256 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:26.751209    2582 generic.go:356] "Generic (PLEG): container finished" podID="5940fb3f-d997-4302-b35d-093be668b9e7" containerID="b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3" exitCode=0
Jul 08 20:27:26.751919 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:26.751390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" event={"ID":"5940fb3f-d997-4302-b35d-093be668b9e7","Type":"ContainerDied","Data":"b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"}
Jul 08 20:27:26.752001 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:26.751929    2582 scope.go:117] "RemoveContainer" containerID="b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"
Jul 08 20:27:26.753104 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:26.753069    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:27:26.753403 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:26.753161    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:27:26.753403 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:26.753215    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 08 20:27:27.125585 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:27.125542    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"]
Jul 08 20:27:27.757957 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:27.757923    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" event={"ID":"5940fb3f-d997-4302-b35d-093be668b9e7","Type":"ContainerStarted","Data":"6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5"}
Jul 08 20:27:27.758364 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:27.758024    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy" containerID="cri-o://6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5" gracePeriod=30
Jul 08 20:27:32.701015 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:32.700975    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:33.024863 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.024826    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:33.159010 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.158972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-credential-socket\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159022    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5940fb3f-d997-4302-b35d-093be668b9e7-istio-podinfo\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159049    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-istio-token\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-certs\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-socket\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159152    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5940fb3f-d997-4302-b35d-093be668b9e7-istiod-ca-cert\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159187    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-data\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159221    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-envoy\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7sp8\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-kube-api-access-x7sp8\") pod \"5940fb3f-d997-4302-b35d-093be668b9e7\" (UID: \"5940fb3f-d997-4302-b35d-093be668b9e7\") "
Jul 08 20:27:33.159518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159327    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:27:33.159518 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159488    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:27:33.159728 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159531    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:27:33.159728 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159639    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-credential-socket\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.159728 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159659    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-certs\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.159728 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159674    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-workload-socket\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.159922 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.159814    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5940fb3f-d997-4302-b35d-093be668b9e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 20:27:33.160143 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.160120    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:27:33.161768 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.161746    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5940fb3f-d997-4302-b35d-093be668b9e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 20:27:33.161854 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.161748    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:27:33.161923 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.161901    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-kube-api-access-x7sp8" (OuterVolumeSpecName: "kube-api-access-x7sp8") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "kube-api-access-x7sp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:27:33.161959 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.161932    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5940fb3f-d997-4302-b35d-093be668b9e7" (UID: "5940fb3f-d997-4302-b35d-093be668b9e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:27:33.261179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.261049    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5940fb3f-d997-4302-b35d-093be668b9e7-istio-podinfo\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.261179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.261116    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-istio-token\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.261179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.261129    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5940fb3f-d997-4302-b35d-093be668b9e7-istiod-ca-cert\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.261179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.261140    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-data\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.261179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.261177    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5940fb3f-d997-4302-b35d-093be668b9e7-istio-envoy\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.261560 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.261195    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7sp8\" (UniqueName: \"kubernetes.io/projected/5940fb3f-d997-4302-b35d-093be668b9e7-kube-api-access-x7sp8\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:33.788738 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.788706    2582 generic.go:356] "Generic (PLEG): container finished" podID="5940fb3f-d997-4302-b35d-093be668b9e7" containerID="6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5" exitCode=0
Jul 08 20:27:33.789225 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.788761    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"
Jul 08 20:27:33.789225 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.788791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" event={"ID":"5940fb3f-d997-4302-b35d-093be668b9e7","Type":"ContainerDied","Data":"6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5"}
Jul 08 20:27:33.789225 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.788851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w" event={"ID":"5940fb3f-d997-4302-b35d-093be668b9e7","Type":"ContainerDied","Data":"942a84a9dd49088e82057627acdb712c5fc532d0668d219b3af3498470aa2a7a"}
Jul 08 20:27:33.789225 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.788874    2582 scope.go:117] "RemoveContainer" containerID="6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5"
Jul 08 20:27:33.798417 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.798392    2582 scope.go:117] "RemoveContainer" containerID="b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"
Jul 08 20:27:33.809199 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.809178    2582 scope.go:117] "RemoveContainer" containerID="6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5"
Jul 08 20:27:33.809542 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:27:33.809518    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5\": container with ID starting with 6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5 not found: ID does not exist" containerID="6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5"
Jul 08 20:27:33.809621 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.809550    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5"} err="failed to get container status \"6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5\": rpc error: code = NotFound desc = could not find container \"6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5\": container with ID starting with 6febd60f5bba2d39318f5ebf12b350f365e2466dcbccf4d919f6de5f19eec4f5 not found: ID does not exist"
Jul 08 20:27:33.809621 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.809574    2582 scope.go:117] "RemoveContainer" containerID="b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"
Jul 08 20:27:33.809913 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:27:33.809875    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3\": container with ID starting with b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3 not found: ID does not exist" containerID="b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"
Jul 08 20:27:33.809982 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.809914    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3"} err="failed to get container status \"b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3\": rpc error: code = NotFound desc = could not find container \"b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3\": container with ID starting with b79ed5f224e79dae47d1492c3135cf3c0e5a6c6c1f30161f93f65a723cac5fc3 not found: ID does not exist"
Jul 08 20:27:33.812233 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.812209    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"]
Jul 08 20:27:33.818240 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:33.818216    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bb4eb1cc-openshift-default-74c84b4799-mtw7w"]
Jul 08 20:27:34.319856 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.319817    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" path="/var/lib/kubelet/pods/5940fb3f-d997-4302-b35d-093be668b9e7/volumes"
Jul 08 20:27:34.503209 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.503173    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"]
Jul 08 20:27:34.503628 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.503611    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy"
Jul 08 20:27:34.503707 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.503630    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy"
Jul 08 20:27:34.503763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.503707    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy"
Jul 08 20:27:34.508535 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.508511    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.511223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.511198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1d6dccd6-serving-cert\""
Jul 08 20:27:34.518040 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.518004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"]
Jul 08 20:27:34.674371 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.674237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4033c2e8-7c78-4b24-bd37-cf57e5722c69-maas-api-tls\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.674371 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.674295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24j46\" (UniqueName: \"kubernetes.io/projected/4033c2e8-7c78-4b24-bd37-cf57e5722c69-kube-api-access-24j46\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.674579 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.674405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4033c2e8-7c78-4b24-bd37-cf57e5722c69-openshift-service-ca\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.775167 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.775122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4033c2e8-7c78-4b24-bd37-cf57e5722c69-maas-api-tls\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.775353 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.775181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24j46\" (UniqueName: \"kubernetes.io/projected/4033c2e8-7c78-4b24-bd37-cf57e5722c69-kube-api-access-24j46\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.775353 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.775214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4033c2e8-7c78-4b24-bd37-cf57e5722c69-openshift-service-ca\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.776010 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.775985    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4033c2e8-7c78-4b24-bd37-cf57e5722c69-openshift-service-ca\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.777633 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.777607    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4033c2e8-7c78-4b24-bd37-cf57e5722c69-maas-api-tls\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.783253 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.783230    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24j46\" (UniqueName: \"kubernetes.io/projected/4033c2e8-7c78-4b24-bd37-cf57e5722c69-kube-api-access-24j46\") pod \"maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:34.822800 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:34.822755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:35.000352 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:35.000306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"]
Jul 08 20:27:35.003037 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:27:35.003006    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4033c2e8_7c78_4b24_bd37_cf57e5722c69.slice/crio-33025954f70057c53ef5494419aa65b92dcbdf2adbbf5c1611eccb204bd461d5 WatchSource:0}: Error finding container 33025954f70057c53ef5494419aa65b92dcbdf2adbbf5c1611eccb204bd461d5: Status 404 returned error can't find the container with id 33025954f70057c53ef5494419aa65b92dcbdf2adbbf5c1611eccb204bd461d5
Jul 08 20:27:35.004468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:35.004445    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 20:27:35.807610 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:35.807574    2582 generic.go:356] "Generic (PLEG): container finished" podID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerID="5069422f2b94dc632476eb56118adfddc8f087804d1cafc5118e61bee8a0a058" exitCode=1
Jul 08 20:27:35.807807 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:35.807640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5" event={"ID":"4033c2e8-7c78-4b24-bd37-cf57e5722c69","Type":"ContainerDied","Data":"5069422f2b94dc632476eb56118adfddc8f087804d1cafc5118e61bee8a0a058"}
Jul 08 20:27:35.807807 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:35.807717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5" event={"ID":"4033c2e8-7c78-4b24-bd37-cf57e5722c69","Type":"ContainerStarted","Data":"33025954f70057c53ef5494419aa65b92dcbdf2adbbf5c1611eccb204bd461d5"}
Jul 08 20:27:35.807965 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:35.807949    2582 scope.go:117] "RemoveContainer" containerID="5069422f2b94dc632476eb56118adfddc8f087804d1cafc5118e61bee8a0a058"
Jul 08 20:27:36.814263 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:36.814229    2582 generic.go:356] "Generic (PLEG): container finished" podID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerID="cd0d42fd74f5018827e91bdcc89c91c444498bdd24bf926a9f0bdcd8ba49a319" exitCode=1
Jul 08 20:27:36.814776 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:36.814296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5" event={"ID":"4033c2e8-7c78-4b24-bd37-cf57e5722c69","Type":"ContainerDied","Data":"cd0d42fd74f5018827e91bdcc89c91c444498bdd24bf926a9f0bdcd8ba49a319"}
Jul 08 20:27:36.814776 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:36.814381    2582 scope.go:117] "RemoveContainer" containerID="5069422f2b94dc632476eb56118adfddc8f087804d1cafc5118e61bee8a0a058"
Jul 08 20:27:36.814776 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:36.814612    2582 scope.go:117] "RemoveContainer" containerID="cd0d42fd74f5018827e91bdcc89c91c444498bdd24bf926a9f0bdcd8ba49a319"
Jul 08 20:27:36.814932 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:27:36.814850    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5_odh-ai-gateway-infra(4033c2e8-7c78-4b24-bd37-cf57e5722c69)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69"
Jul 08 20:27:37.821225 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:37.821195    2582 scope.go:117] "RemoveContainer" containerID="cd0d42fd74f5018827e91bdcc89c91c444498bdd24bf926a9f0bdcd8ba49a319"
Jul 08 20:27:37.821616 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:27:37.821440    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5_odh-ai-gateway-infra(4033c2e8-7c78-4b24-bd37-cf57e5722c69)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69"
Jul 08 20:27:39.275455 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.275388    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"]
Jul 08 20:27:39.410600 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.410572    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:39.513485 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.513449    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24j46\" (UniqueName: \"kubernetes.io/projected/4033c2e8-7c78-4b24-bd37-cf57e5722c69-kube-api-access-24j46\") pod \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") "
Jul 08 20:27:39.513659 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.513496    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4033c2e8-7c78-4b24-bd37-cf57e5722c69-maas-api-tls\") pod \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") "
Jul 08 20:27:39.513659 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.513547    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4033c2e8-7c78-4b24-bd37-cf57e5722c69-openshift-service-ca\") pod \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\" (UID: \"4033c2e8-7c78-4b24-bd37-cf57e5722c69\") "
Jul 08 20:27:39.513973 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.513941    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4033c2e8-7c78-4b24-bd37-cf57e5722c69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4033c2e8-7c78-4b24-bd37-cf57e5722c69" (UID: "4033c2e8-7c78-4b24-bd37-cf57e5722c69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 20:27:39.515693 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.515666    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4033c2e8-7c78-4b24-bd37-cf57e5722c69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4033c2e8-7c78-4b24-bd37-cf57e5722c69" (UID: "4033c2e8-7c78-4b24-bd37-cf57e5722c69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:27:39.515923 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.515875    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4033c2e8-7c78-4b24-bd37-cf57e5722c69-kube-api-access-24j46" (OuterVolumeSpecName: "kube-api-access-24j46") pod "4033c2e8-7c78-4b24-bd37-cf57e5722c69" (UID: "4033c2e8-7c78-4b24-bd37-cf57e5722c69"). InnerVolumeSpecName "kube-api-access-24j46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:27:39.614740 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.614697    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4033c2e8-7c78-4b24-bd37-cf57e5722c69-openshift-service-ca\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:39.614740 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.614740    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24j46\" (UniqueName: \"kubernetes.io/projected/4033c2e8-7c78-4b24-bd37-cf57e5722c69-kube-api-access-24j46\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:39.614942 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.614755    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4033c2e8-7c78-4b24-bd37-cf57e5722c69-maas-api-tls\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:27:39.832358 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.832325    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"
Jul 08 20:27:39.832358 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.832311    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5" event={"ID":"4033c2e8-7c78-4b24-bd37-cf57e5722c69","Type":"ContainerDied","Data":"33025954f70057c53ef5494419aa65b92dcbdf2adbbf5c1611eccb204bd461d5"}
Jul 08 20:27:39.832611 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.832396    2582 scope.go:117] "RemoveContainer" containerID="cd0d42fd74f5018827e91bdcc89c91c444498bdd24bf926a9f0bdcd8ba49a319"
Jul 08 20:27:39.853281 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.853256    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"]
Jul 08 20:27:39.857300 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:39.857275    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1d6dccd6-685fd499d4-5whs5"]
Jul 08 20:27:40.318502 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:27:40.318467    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" path="/var/lib/kubelet/pods/4033c2e8-7c78-4b24-bd37-cf57e5722c69/volumes"
Jul 08 20:30:20.576165 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576122    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"]
Jul 08 20:30:20.576785 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576763    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerName="maas-api"
Jul 08 20:30:20.576829 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576790    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerName="maas-api"
Jul 08 20:30:20.576829 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576811    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy"
Jul 08 20:30:20.576829 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576820    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy"
Jul 08 20:30:20.576949 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576844    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerName="maas-api"
Jul 08 20:30:20.576949 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576854    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerName="maas-api"
Jul 08 20:30:20.577054 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576962    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerName="maas-api"
Jul 08 20:30:20.577054 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576977    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5940fb3f-d997-4302-b35d-093be668b9e7" containerName="istio-proxy"
Jul 08 20:30:20.577054 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.576985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4033c2e8-7c78-4b24-bd37-cf57e5722c69" containerName="maas-api"
Jul 08 20:30:20.580212 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.580187    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.582943 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.582919    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5154d846\"/\"openshift-service-ca.crt\""
Jul 08 20:30:20.583086 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.582977    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5154d846\"/\"kube-root-ca.crt\""
Jul 08 20:30:20.584428 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.584405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5154d846\"/\"default-dockercfg-r9l6n\""
Jul 08 20:30:20.584546 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.584454    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5154d846\"/\"e2e-lifecycle-model-5154d846-kserve-self-signed-certs\""
Jul 08 20:30:20.587177 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.587155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"]
Jul 08 20:30:20.651227 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.651187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-model-cache\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.651456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.651357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-tmp-dir\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.651456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.651400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c93a72-e247-44e0-a541-5a37ea9d6207-tls-certs\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.651456 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.651430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hndgg\" (UniqueName: \"kubernetes.io/projected/65c93a72-e247-44e0-a541-5a37ea9d6207-kube-api-access-hndgg\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.651620 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.651470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-dshm\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.651620 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.651495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-home\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752431 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-tmp-dir\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c93a72-e247-44e0-a541-5a37ea9d6207-tls-certs\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hndgg\" (UniqueName: \"kubernetes.io/projected/65c93a72-e247-44e0-a541-5a37ea9d6207-kube-api-access-hndgg\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752597    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-dshm\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-home\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752899 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-model-cache\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.752899 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.752831    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-tmp-dir\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.753039 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.753023    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-model-cache\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.753039 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.753029    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-home\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.754785 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.754762    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-dshm\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.755065 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.755046    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c93a72-e247-44e0-a541-5a37ea9d6207-tls-certs\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.761662 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.761637    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hndgg\" (UniqueName: \"kubernetes.io/projected/65c93a72-e247-44e0-a541-5a37ea9d6207-kube-api-access-hndgg\") pod \"e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") " pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:20.891040 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:20.890941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:21.033956 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:21.033928    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"]
Jul 08 20:30:21.036593 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:30:21.036560    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c93a72_e247_44e0_a541_5a37ea9d6207.slice/crio-805eda37cf7084468c90869a3068814f2bc5fc8b30fb64c4ad1d530b8817c883 WatchSource:0}: Error finding container 805eda37cf7084468c90869a3068814f2bc5fc8b30fb64c4ad1d530b8817c883: Status 404 returned error can't find the container with id 805eda37cf7084468c90869a3068814f2bc5fc8b30fb64c4ad1d530b8817c883
Jul 08 20:30:21.621894 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:21.621861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl" event={"ID":"65c93a72-e247-44e0-a541-5a37ea9d6207","Type":"ContainerStarted","Data":"344fc49532ef18c5f383cb7735ba7a96bd5c475cc48e564203b2813f9be1bee3"}
Jul 08 20:30:21.622366 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:21.621911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl" event={"ID":"65c93a72-e247-44e0-a541-5a37ea9d6207","Type":"ContainerStarted","Data":"805eda37cf7084468c90869a3068814f2bc5fc8b30fb64c4ad1d530b8817c883"}
Jul 08 20:30:21.637907 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:21.637856    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl" podStartSLOduration=1.637840248 podStartE2EDuration="1.637840248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:30:21.636819012 +0000 UTC m=+1827.847825650" watchObservedRunningTime="2026-07-08 20:30:21.637840248 +0000 UTC m=+1827.848846874"
Jul 08 20:30:30.891394 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:30.891334    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:30.891394 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:30.891413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:30.904145 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:30.904116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:31.679924 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:31.679894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:30:53.686740 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:30:53.686699    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"]
Jul 08 20:31:08.707955 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:08.707890    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl" podUID="65c93a72-e247-44e0-a541-5a37ea9d6207" containerName="main" containerID="cri-o://344fc49532ef18c5f383cb7735ba7a96bd5c475cc48e564203b2813f9be1bee3" gracePeriod=45
Jul 08 20:31:08.846140 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:08.846109    2582 generic.go:356] "Generic (PLEG): container finished" podID="65c93a72-e247-44e0-a541-5a37ea9d6207" containerID="344fc49532ef18c5f383cb7735ba7a96bd5c475cc48e564203b2813f9be1bee3" exitCode=0
Jul 08 20:31:08.846298 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:08.846169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl" event={"ID":"65c93a72-e247-44e0-a541-5a37ea9d6207","Type":"ContainerDied","Data":"344fc49532ef18c5f383cb7735ba7a96bd5c475cc48e564203b2813f9be1bee3"}
Jul 08 20:31:08.965930 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:08.965856    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:31:09.073289 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073251    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hndgg\" (UniqueName: \"kubernetes.io/projected/65c93a72-e247-44e0-a541-5a37ea9d6207-kube-api-access-hndgg\") pod \"65c93a72-e247-44e0-a541-5a37ea9d6207\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") "
Jul 08 20:31:09.073529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073304    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-tmp-dir\") pod \"65c93a72-e247-44e0-a541-5a37ea9d6207\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") "
Jul 08 20:31:09.073529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073356    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c93a72-e247-44e0-a541-5a37ea9d6207-tls-certs\") pod \"65c93a72-e247-44e0-a541-5a37ea9d6207\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") "
Jul 08 20:31:09.073529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073375    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-home\") pod \"65c93a72-e247-44e0-a541-5a37ea9d6207\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") "
Jul 08 20:31:09.073529 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073504    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-model-cache\") pod \"65c93a72-e247-44e0-a541-5a37ea9d6207\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") "
Jul 08 20:31:09.073750 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073560    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-dshm\") pod \"65c93a72-e247-44e0-a541-5a37ea9d6207\" (UID: \"65c93a72-e247-44e0-a541-5a37ea9d6207\") "
Jul 08 20:31:09.073750 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073615    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65c93a72-e247-44e0-a541-5a37ea9d6207" (UID: "65c93a72-e247-44e0-a541-5a37ea9d6207"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:31:09.073750 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073631    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-home" (OuterVolumeSpecName: "home") pod "65c93a72-e247-44e0-a541-5a37ea9d6207" (UID: "65c93a72-e247-44e0-a541-5a37ea9d6207"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:31:09.073905 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073749    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-model-cache" (OuterVolumeSpecName: "model-cache") pod "65c93a72-e247-44e0-a541-5a37ea9d6207" (UID: "65c93a72-e247-44e0-a541-5a37ea9d6207"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:31:09.073905 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073897    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-tmp-dir\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:31:09.074014 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073913    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-home\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:31:09.074014 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.073926    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-model-cache\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:31:09.075700 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.075666    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-dshm" (OuterVolumeSpecName: "dshm") pod "65c93a72-e247-44e0-a541-5a37ea9d6207" (UID: "65c93a72-e247-44e0-a541-5a37ea9d6207"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:31:09.075798 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.075776    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c93a72-e247-44e0-a541-5a37ea9d6207-kube-api-access-hndgg" (OuterVolumeSpecName: "kube-api-access-hndgg") pod "65c93a72-e247-44e0-a541-5a37ea9d6207" (UID: "65c93a72-e247-44e0-a541-5a37ea9d6207"). InnerVolumeSpecName "kube-api-access-hndgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:31:09.075848 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.075791    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65c93a72-e247-44e0-a541-5a37ea9d6207-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65c93a72-e247-44e0-a541-5a37ea9d6207" (UID: "65c93a72-e247-44e0-a541-5a37ea9d6207"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:31:09.175308 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.175271    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hndgg\" (UniqueName: \"kubernetes.io/projected/65c93a72-e247-44e0-a541-5a37ea9d6207-kube-api-access-hndgg\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:31:09.175308 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.175303    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c93a72-e247-44e0-a541-5a37ea9d6207-tls-certs\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:31:09.175308 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.175327    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c93a72-e247-44e0-a541-5a37ea9d6207-dshm\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:31:09.852173 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.852146    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"
Jul 08 20:31:09.852574 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.852142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl" event={"ID":"65c93a72-e247-44e0-a541-5a37ea9d6207","Type":"ContainerDied","Data":"805eda37cf7084468c90869a3068814f2bc5fc8b30fb64c4ad1d530b8817c883"}
Jul 08 20:31:09.852574 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.852273    2582 scope.go:117] "RemoveContainer" containerID="344fc49532ef18c5f383cb7735ba7a96bd5c475cc48e564203b2813f9be1bee3"
Jul 08 20:31:09.878679 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.878642    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"]
Jul 08 20:31:09.881080 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:09.881054    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5154d846/e2e-lifecycle-model-5154d846-kserve-7cf47b4f5-wrfbl"]
Jul 08 20:31:10.318745 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:31:10.318713    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c93a72-e247-44e0-a541-5a37ea9d6207" path="/var/lib/kubelet/pods/65c93a72-e247-44e0-a541-5a37ea9d6207/volumes"
Jul 08 20:33:11.580363 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.580267    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"]
Jul 08 20:33:11.580803 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.580714    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c93a72-e247-44e0-a541-5a37ea9d6207" containerName="main"
Jul 08 20:33:11.580803 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.580735    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c93a72-e247-44e0-a541-5a37ea9d6207" containerName="main"
Jul 08 20:33:11.580875 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.580820    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c93a72-e247-44e0-a541-5a37ea9d6207" containerName="main"
Jul 08 20:33:11.583912 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.583889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.588149 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.588120    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-930853\"/\"kube-root-ca.crt\""
Jul 08 20:33:11.588304 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.588128    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-930853\"/\"default-dockercfg-xmf6p\""
Jul 08 20:33:11.588304 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.588210    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-930853\"/\"test-model-930853-kserve-self-signed-certs\""
Jul 08 20:33:11.588304 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.588131    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-930853\"/\"openshift-service-ca.crt\""
Jul 08 20:33:11.593044 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.593022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"]
Jul 08 20:33:11.660023 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.659981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-model-cache\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.660023 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.660025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-tmp-dir\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.660268 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.660088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b33e239-7e0d-4d99-a648-71f753a353ad-tls-certs\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.660268 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.660110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvrt4\" (UniqueName: \"kubernetes.io/projected/8b33e239-7e0d-4d99-a648-71f753a353ad-kube-api-access-mvrt4\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.660268 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.660178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-dshm\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.660268 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.660213    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-home\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761431 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-model-cache\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761431 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-tmp-dir\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761687 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b33e239-7e0d-4d99-a648-71f753a353ad-tls-certs\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761687 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvrt4\" (UniqueName: \"kubernetes.io/projected/8b33e239-7e0d-4d99-a648-71f753a353ad-kube-api-access-mvrt4\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761687 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-dshm\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761687 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-home\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761906 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-model-cache\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761946 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761899    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-tmp-dir\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.761989 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.761972    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-home\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.763850 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.763826    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-dshm\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.764146 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.764125    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b33e239-7e0d-4d99-a648-71f753a353ad-tls-certs\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.770002 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.769982    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvrt4\" (UniqueName: \"kubernetes.io/projected/8b33e239-7e0d-4d99-a648-71f753a353ad-kube-api-access-mvrt4\") pod \"test-model-930853-kserve-849f49c6f-5b4hm\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") " pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:11.894220 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:11.894108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:12.029008 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:12.028960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"]
Jul 08 20:33:12.031792 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:33:12.031763    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b33e239_7e0d_4d99_a648_71f753a353ad.slice/crio-64020af56885e2861751fbd2a86efc18be34e30f35287a057f5eb9898db1165a WatchSource:0}: Error finding container 64020af56885e2861751fbd2a86efc18be34e30f35287a057f5eb9898db1165a: Status 404 returned error can't find the container with id 64020af56885e2861751fbd2a86efc18be34e30f35287a057f5eb9898db1165a
Jul 08 20:33:12.441310 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:12.441264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm" event={"ID":"8b33e239-7e0d-4d99-a648-71f753a353ad","Type":"ContainerStarted","Data":"9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6"}
Jul 08 20:33:12.441520 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:12.441334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm" event={"ID":"8b33e239-7e0d-4d99-a648-71f753a353ad","Type":"ContainerStarted","Data":"64020af56885e2861751fbd2a86efc18be34e30f35287a057f5eb9898db1165a"}
Jul 08 20:33:12.457621 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:12.457561    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm" podStartSLOduration=1.457537606 podStartE2EDuration="1.457537606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:33:12.45721139 +0000 UTC m=+1998.668218016" watchObservedRunningTime="2026-07-08 20:33:12.457537606 +0000 UTC m=+1998.668544235"
Jul 08 20:33:21.894415 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:21.894377    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:21.894415 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:21.894424    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:21.907105 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:21.907077    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:22.500992 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:22.500957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:33:45.274404 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.274364    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"]
Jul 08 20:33:45.278241 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.278216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.282623 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.282595    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-879445\"/\"kube-root-ca.crt\""
Jul 08 20:33:45.282778 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.282655    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-879445\"/\"test-model-879445-kserve-self-signed-certs\""
Jul 08 20:33:45.282778 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.282677    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-879445\"/\"default-dockercfg-6kzns\""
Jul 08 20:33:45.282778 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.282703    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-879445\"/\"openshift-service-ca.crt\""
Jul 08 20:33:45.287458 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.287434    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"]
Jul 08 20:33:45.351607 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.351570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-tmp-dir\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.351779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.351612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-model-cache\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.351779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.351644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6477413e-fd3e-4d5f-bad8-d8089c016024-tls-certs\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.351779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.351677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-dshm\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.351779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.351704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-home\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.351779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.351762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24q4r\" (UniqueName: \"kubernetes.io/projected/6477413e-fd3e-4d5f-bad8-d8089c016024-kube-api-access-24q4r\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.452753 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.452710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24q4r\" (UniqueName: \"kubernetes.io/projected/6477413e-fd3e-4d5f-bad8-d8089c016024-kube-api-access-24q4r\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.452937 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.452791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-tmp-dir\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.452937 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.452816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-model-cache\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.452937 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.452835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6477413e-fd3e-4d5f-bad8-d8089c016024-tls-certs\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.452937 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.452852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-dshm\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.452937 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.452883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-home\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.453294 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.453269    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-model-cache\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.453381 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.453358    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-tmp-dir\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.453438 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.453381    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-home\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.455308 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.455285    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-dshm\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.455509 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.455490    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6477413e-fd3e-4d5f-bad8-d8089c016024-tls-certs\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.463040 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.463007    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24q4r\" (UniqueName: \"kubernetes.io/projected/6477413e-fd3e-4d5f-bad8-d8089c016024-kube-api-access-24q4r\") pod \"test-model-879445-kserve-c49cc8779-c55bm\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") " pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.589118 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.589079    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:45.726012 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:45.725985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"]
Jul 08 20:33:45.728261 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:33:45.728232    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6477413e_fd3e_4d5f_bad8_d8089c016024.slice/crio-977538aff9a5e40938a3d543f3a16ad7bfafefd137fc0c689e65a9df7ead4c0a WatchSource:0}: Error finding container 977538aff9a5e40938a3d543f3a16ad7bfafefd137fc0c689e65a9df7ead4c0a: Status 404 returned error can't find the container with id 977538aff9a5e40938a3d543f3a16ad7bfafefd137fc0c689e65a9df7ead4c0a
Jul 08 20:33:46.606593 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:46.606555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm" event={"ID":"6477413e-fd3e-4d5f-bad8-d8089c016024","Type":"ContainerStarted","Data":"6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e"}
Jul 08 20:33:46.607044 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:46.606603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm" event={"ID":"6477413e-fd3e-4d5f-bad8-d8089c016024","Type":"ContainerStarted","Data":"977538aff9a5e40938a3d543f3a16ad7bfafefd137fc0c689e65a9df7ead4c0a"}
Jul 08 20:33:46.623914 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:46.623864    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm" podStartSLOduration=1.623849394 podStartE2EDuration="1.623849394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 20:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:33:46.622893581 +0000 UTC m=+2032.833900210" watchObservedRunningTime="2026-07-08 20:33:46.623849394 +0000 UTC m=+2032.834856021"
Jul 08 20:33:55.589615 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:55.589580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:55.590095 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:55.589629    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:55.602137 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:55.602112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:33:55.660641 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:33:55.660609    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:34:25.019202 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:25.019124    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"]
Jul 08 20:34:25.957121 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:25.957087    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"]
Jul 08 20:34:40.038954 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.038908    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm" podUID="8b33e239-7e0d-4d99-a648-71f753a353ad" containerName="main" containerID="cri-o://9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6" gracePeriod=45
Jul 08 20:34:40.293553 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.293486    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:34:40.341585 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-dshm\") pod \"8b33e239-7e0d-4d99-a648-71f753a353ad\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") "
Jul 08 20:34:40.341775 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341593    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b33e239-7e0d-4d99-a648-71f753a353ad-tls-certs\") pod \"8b33e239-7e0d-4d99-a648-71f753a353ad\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") "
Jul 08 20:34:40.341775 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341644    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-home\") pod \"8b33e239-7e0d-4d99-a648-71f753a353ad\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") "
Jul 08 20:34:40.341775 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341675    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvrt4\" (UniqueName: \"kubernetes.io/projected/8b33e239-7e0d-4d99-a648-71f753a353ad-kube-api-access-mvrt4\") pod \"8b33e239-7e0d-4d99-a648-71f753a353ad\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") "
Jul 08 20:34:40.341775 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341711    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-tmp-dir\") pod \"8b33e239-7e0d-4d99-a648-71f753a353ad\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") "
Jul 08 20:34:40.341775 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-model-cache\") pod \"8b33e239-7e0d-4d99-a648-71f753a353ad\" (UID: \"8b33e239-7e0d-4d99-a648-71f753a353ad\") "
Jul 08 20:34:40.342063 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.341971    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-home" (OuterVolumeSpecName: "home") pod "8b33e239-7e0d-4d99-a648-71f753a353ad" (UID: "8b33e239-7e0d-4d99-a648-71f753a353ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:40.342136 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.342097    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b33e239-7e0d-4d99-a648-71f753a353ad" (UID: "8b33e239-7e0d-4d99-a648-71f753a353ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:40.342136 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.342114    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-home\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:40.342248 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.342200    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b33e239-7e0d-4d99-a648-71f753a353ad" (UID: "8b33e239-7e0d-4d99-a648-71f753a353ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:40.344026 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.343993    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b33e239-7e0d-4d99-a648-71f753a353ad-kube-api-access-mvrt4" (OuterVolumeSpecName: "kube-api-access-mvrt4") pod "8b33e239-7e0d-4d99-a648-71f753a353ad" (UID: "8b33e239-7e0d-4d99-a648-71f753a353ad"). InnerVolumeSpecName "kube-api-access-mvrt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:34:40.344141 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.344124    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-dshm" (OuterVolumeSpecName: "dshm") pod "8b33e239-7e0d-4d99-a648-71f753a353ad" (UID: "8b33e239-7e0d-4d99-a648-71f753a353ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:40.344184 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.344154    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b33e239-7e0d-4d99-a648-71f753a353ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b33e239-7e0d-4d99-a648-71f753a353ad" (UID: "8b33e239-7e0d-4d99-a648-71f753a353ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:34:40.442880 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.442837    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-dshm\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:40.442880 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.442877    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b33e239-7e0d-4d99-a648-71f753a353ad-tls-certs\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:40.443083 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.442892    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvrt4\" (UniqueName: \"kubernetes.io/projected/8b33e239-7e0d-4d99-a648-71f753a353ad-kube-api-access-mvrt4\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:40.443083 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.442904    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-tmp-dir\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:40.443083 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.442917    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b33e239-7e0d-4d99-a648-71f753a353ad-model-cache\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:40.871253 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.871218    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b33e239-7e0d-4d99-a648-71f753a353ad" containerID="9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6" exitCode=0
Jul 08 20:34:40.871457 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.871266    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"
Jul 08 20:34:40.871457 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.871311    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm" event={"ID":"8b33e239-7e0d-4d99-a648-71f753a353ad","Type":"ContainerDied","Data":"9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6"}
Jul 08 20:34:40.871457 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.871372    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm" event={"ID":"8b33e239-7e0d-4d99-a648-71f753a353ad","Type":"ContainerDied","Data":"64020af56885e2861751fbd2a86efc18be34e30f35287a057f5eb9898db1165a"}
Jul 08 20:34:40.871457 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.871392    2582 scope.go:117] "RemoveContainer" containerID="9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6"
Jul 08 20:34:40.880452 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.880434    2582 scope.go:117] "RemoveContainer" containerID="9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6"
Jul 08 20:34:40.880714 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:34:40.880691    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6\": container with ID starting with 9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6 not found: ID does not exist" containerID="9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6"
Jul 08 20:34:40.880784 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.880726    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6"} err="failed to get container status \"9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6\": rpc error: code = NotFound desc = could not find container \"9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6\": container with ID starting with 9d460a7465ff02893389a54386609464caf68971f82ab8c4a55d7595464415d6 not found: ID does not exist"
Jul 08 20:34:40.894131 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.894102    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"]
Jul 08 20:34:40.898327 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.898295    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-930853/test-model-930853-kserve-849f49c6f-5b4hm"]
Jul 08 20:34:40.977470 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:40.977431    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm" podUID="6477413e-fd3e-4d5f-bad8-d8089c016024" containerName="main" containerID="cri-o://6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e" gracePeriod=45
Jul 08 20:34:41.248168 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.248133    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:34:41.349332 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349272    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-tmp-dir\") pod \"6477413e-fd3e-4d5f-bad8-d8089c016024\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") "
Jul 08 20:34:41.349495 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24q4r\" (UniqueName: \"kubernetes.io/projected/6477413e-fd3e-4d5f-bad8-d8089c016024-kube-api-access-24q4r\") pod \"6477413e-fd3e-4d5f-bad8-d8089c016024\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") "
Jul 08 20:34:41.349495 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-model-cache\") pod \"6477413e-fd3e-4d5f-bad8-d8089c016024\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") "
Jul 08 20:34:41.349495 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6477413e-fd3e-4d5f-bad8-d8089c016024-tls-certs\") pod \"6477413e-fd3e-4d5f-bad8-d8089c016024\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") "
Jul 08 20:34:41.349495 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349447    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-dshm\") pod \"6477413e-fd3e-4d5f-bad8-d8089c016024\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") "
Jul 08 20:34:41.349495 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349472    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-home\") pod \"6477413e-fd3e-4d5f-bad8-d8089c016024\" (UID: \"6477413e-fd3e-4d5f-bad8-d8089c016024\") "
Jul 08 20:34:41.349791 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349632    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6477413e-fd3e-4d5f-bad8-d8089c016024" (UID: "6477413e-fd3e-4d5f-bad8-d8089c016024"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:41.349791 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349707    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-model-cache" (OuterVolumeSpecName: "model-cache") pod "6477413e-fd3e-4d5f-bad8-d8089c016024" (UID: "6477413e-fd3e-4d5f-bad8-d8089c016024"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:41.349791 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349738    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-tmp-dir\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:41.349791 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.349770    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-home" (OuterVolumeSpecName: "home") pod "6477413e-fd3e-4d5f-bad8-d8089c016024" (UID: "6477413e-fd3e-4d5f-bad8-d8089c016024"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:41.351647 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.351626    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-dshm" (OuterVolumeSpecName: "dshm") pod "6477413e-fd3e-4d5f-bad8-d8089c016024" (UID: "6477413e-fd3e-4d5f-bad8-d8089c016024"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 20:34:41.351721 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.351672    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6477413e-fd3e-4d5f-bad8-d8089c016024-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6477413e-fd3e-4d5f-bad8-d8089c016024" (UID: "6477413e-fd3e-4d5f-bad8-d8089c016024"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 20:34:41.351763 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.351737    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6477413e-fd3e-4d5f-bad8-d8089c016024-kube-api-access-24q4r" (OuterVolumeSpecName: "kube-api-access-24q4r") pod "6477413e-fd3e-4d5f-bad8-d8089c016024" (UID: "6477413e-fd3e-4d5f-bad8-d8089c016024"). InnerVolumeSpecName "kube-api-access-24q4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 20:34:41.451223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.451127    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-model-cache\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:41.451223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.451156    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6477413e-fd3e-4d5f-bad8-d8089c016024-tls-certs\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:41.451223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.451164    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-dshm\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:41.451223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.451173    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6477413e-fd3e-4d5f-bad8-d8089c016024-home\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:41.451223 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.451186    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24q4r\" (UniqueName: \"kubernetes.io/projected/6477413e-fd3e-4d5f-bad8-d8089c016024-kube-api-access-24q4r\") on node \"ip-10-0-136-70.ec2.internal\" DevicePath \"\""
Jul 08 20:34:41.878709 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.878676    2582 generic.go:356] "Generic (PLEG): container finished" podID="6477413e-fd3e-4d5f-bad8-d8089c016024" containerID="6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e" exitCode=0
Jul 08 20:34:41.878870 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.878728    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"
Jul 08 20:34:41.878870 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.878764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm" event={"ID":"6477413e-fd3e-4d5f-bad8-d8089c016024","Type":"ContainerDied","Data":"6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e"}
Jul 08 20:34:41.878870 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.878805    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm" event={"ID":"6477413e-fd3e-4d5f-bad8-d8089c016024","Type":"ContainerDied","Data":"977538aff9a5e40938a3d543f3a16ad7bfafefd137fc0c689e65a9df7ead4c0a"}
Jul 08 20:34:41.878870 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.878821    2582 scope.go:117] "RemoveContainer" containerID="6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e"
Jul 08 20:34:41.888184 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.888167    2582 scope.go:117] "RemoveContainer" containerID="6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e"
Jul 08 20:34:41.888469 ip-10-0-136-70 kubenswrapper[2582]: E0708 20:34:41.888452    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e\": container with ID starting with 6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e not found: ID does not exist" containerID="6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e"
Jul 08 20:34:41.888542 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.888480    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e"} err="failed to get container status \"6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e\": rpc error: code = NotFound desc = could not find container \"6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e\": container with ID starting with 6715ae996db6375dba4ee0c1779553e786bbf71a1db5669429f9ef6df3bca95e not found: ID does not exist"
Jul 08 20:34:41.901063 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.901035    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"]
Jul 08 20:34:41.905071 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:41.905049    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-879445/test-model-879445-kserve-c49cc8779-c55bm"]
Jul 08 20:34:42.319291 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:42.319246    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6477413e-fd3e-4d5f-bad8-d8089c016024" path="/var/lib/kubelet/pods/6477413e-fd3e-4d5f-bad8-d8089c016024/volumes"
Jul 08 20:34:42.319849 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:34:42.319827    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b33e239-7e0d-4d99-a648-71f753a353ad" path="/var/lib/kubelet/pods/8b33e239-7e0d-4d99-a648-71f753a353ad/volumes"
Jul 08 20:39:32.910084 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:32.910042    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-864dfc7576-qcdzh_362120d3-18a1-4885-bc0d-125908ce2ba5/authorino/0.log"
Jul 08 20:39:38.374657 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:38.374626    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rhlnk_94a2c68d-b4ec-4687-bab1-711a55febffb/manager/0.log"
Jul 08 20:39:38.526575 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:38.526544    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4lr5z_67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d/manager/0.log"
Jul 08 20:39:38.687523 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:38.687444    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bbb8c8848-4dhnp_8bb2eea7-8292-4b85-8718-49aa801b3dee/manager/0.log"
Jul 08 20:39:38.825801 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:38.825770    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zs8mg_cd37a585-0296-40da-9982-9aae09a476bc/server/0.log"
Jul 08 20:39:38.962473 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:38.962395    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vdcbj_b6c60359-3796-449a-ac37-67f03fa68206/manager/0.log"
Jul 08 20:39:39.120822 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:39.120797    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67959458dc-fbfbs_2e3dfdfb-4cd6-4069-ab1b-433f1916ba65/copy-manifests/0.log"
Jul 08 20:39:39.127739 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:39.127717    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67959458dc-fbfbs_2e3dfdfb-4cd6-4069-ab1b-433f1916ba65/manager/0.log"
Jul 08 20:39:40.958876 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:40.958833    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-864dfc7576-qcdzh_362120d3-18a1-4885-bc0d-125908ce2ba5/authorino/0.log"
Jul 08 20:39:41.100261 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:41.100222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-l8pck_436f8f51-2802-4187-9bb9-c266b3642fd8/manager/0.log"
Jul 08 20:39:41.490462 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:41.490429    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tfjtg_41c7b885-0358-4231-a7be-866267ce55d8/registry-server/0.log"
Jul 08 20:39:41.644124 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:41.644091    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cqtqm_237991a3-fd57-461b-bca5-1f4ac3fe2e88/manager/0.log"
Jul 08 20:39:41.940932 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:41.940896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gpptx_b4833b06-42ff-458f-a2b1-7fd2a558cda8/manager/0.log"
Jul 08 20:39:42.363177 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:42.363141    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lh7zg_4492635f-c6ff-4351-b0ed-99caa488d8bc/istio-proxy/0.log"
Jul 08 20:39:42.637377 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:42.637261    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-789db8bf69-dhp7g_cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b/kube-auth-proxy/0.log"
Jul 08 20:39:42.907609 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:42.907518    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/1.log"
Jul 08 20:39:43.191189 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:43.191096    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dfd4t_c5e09a59-d18a-4663-a267-a62f788c5a14/payload-processing/0.log"
Jul 08 20:39:43.890644 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:43.890612    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7gzjf_48e04edf-ee1d-4d72-a6e9-4eab893473c6/main/0.log"
Jul 08 20:39:52.592117 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:52.592079    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7xrb4_d73cd7ac-b968-4aff-a0b6-c0b1f6a06e54/global-pull-secret-syncer/0.log"
Jul 08 20:39:52.718352 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:52.718306    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v4x7k_3d26a251-cab9-46e9-8b30-9f9077ce8180/konnectivity-agent/0.log"
Jul 08 20:39:52.792519 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:52.792484    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-70.ec2.internal_746e513d115f3461d223f76aeed02dcc/haproxy/0.log"
Jul 08 20:39:57.631058 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:57.631019    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-864dfc7576-qcdzh_362120d3-18a1-4885-bc0d-125908ce2ba5/authorino/0.log"
Jul 08 20:39:57.662161 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:57.662133    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-l8pck_436f8f51-2802-4187-9bb9-c266b3642fd8/manager/0.log"
Jul 08 20:39:57.768817 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:57.768788    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tfjtg_41c7b885-0358-4231-a7be-866267ce55d8/registry-server/0.log"
Jul 08 20:39:57.854102 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:57.854059    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cqtqm_237991a3-fd57-461b-bca5-1f4ac3fe2e88/manager/0.log"
Jul 08 20:39:57.942099 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:57.941996    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gpptx_b4833b06-42ff-458f-a2b1-7fd2a558cda8/manager/0.log"
Jul 08 20:39:59.913731 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:39:59.913697    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-xv26s_f2d003e6-8881-4b13-a624-da375c6d57f3/cluster-monitoring-operator/0.log"
Jul 08 20:40:00.167955 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:00.167863    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79wdj_7ac98df1-1b56-4f03-831a-a097cce4bb06/node-exporter/0.log"
Jul 08 20:40:00.221309 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:00.221270    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79wdj_7ac98df1-1b56-4f03-831a-a097cce4bb06/kube-rbac-proxy/0.log"
Jul 08 20:40:00.244253 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:00.244229    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79wdj_7ac98df1-1b56-4f03-831a-a097cce4bb06/init-textfile/0.log"
Jul 08 20:40:03.196245 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196208    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"]
Jul 08 20:40:03.196671 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196601    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6477413e-fd3e-4d5f-bad8-d8089c016024" containerName="main"
Jul 08 20:40:03.196671 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196613    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6477413e-fd3e-4d5f-bad8-d8089c016024" containerName="main"
Jul 08 20:40:03.196671 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196634    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b33e239-7e0d-4d99-a648-71f753a353ad" containerName="main"
Jul 08 20:40:03.196671 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196639    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b33e239-7e0d-4d99-a648-71f753a353ad" containerName="main"
Jul 08 20:40:03.196811 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196699    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6477413e-fd3e-4d5f-bad8-d8089c016024" containerName="main"
Jul 08 20:40:03.196811 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.196707    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b33e239-7e0d-4d99-a648-71f753a353ad" containerName="main"
Jul 08 20:40:03.199699 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.199678    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.202468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.202438    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9gq7f\"/\"kube-root-ca.crt\""
Jul 08 20:40:03.202468 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.202457    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9gq7f\"/\"openshift-service-ca.crt\""
Jul 08 20:40:03.202662 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.202505    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9gq7f\"/\"default-dockercfg-bbkdr\""
Jul 08 20:40:03.209090 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.209065    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"]
Jul 08 20:40:03.246595 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.246553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-lib-modules\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.246595 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.246594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn5v8\" (UniqueName: \"kubernetes.io/projected/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-kube-api-access-tn5v8\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.246863 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.246624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-sys\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.246863 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.246735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-proc\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.246863 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.246798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-podres\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347414 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-lib-modules\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347414 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn5v8\" (UniqueName: \"kubernetes.io/projected/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-kube-api-access-tn5v8\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-sys\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347490    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-proc\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-podres\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347584    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-sys\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347584    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-proc\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347584    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-lib-modules\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.347719 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.347677    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-podres\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.356276 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.356244    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn5v8\" (UniqueName: \"kubernetes.io/projected/1247ccb3-e7b3-4e72-a929-f7d6dfef57dc-kube-api-access-tn5v8\") pod \"perf-node-gather-daemonset-pkpl8\" (UID: \"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc\") " pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.511489 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.511375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:03.649188 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.649162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"]
Jul 08 20:40:03.651526 ip-10-0-136-70 kubenswrapper[2582]: W0708 20:40:03.651501    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1247ccb3_e7b3_4e72_a929_f7d6dfef57dc.slice/crio-c4e993c4fd1cb5ec6e17b655b3c18b1e8c190bdcbcc79f5fcf9ba1149bef2e0b WatchSource:0}: Error finding container c4e993c4fd1cb5ec6e17b655b3c18b1e8c190bdcbcc79f5fcf9ba1149bef2e0b: Status 404 returned error can't find the container with id c4e993c4fd1cb5ec6e17b655b3c18b1e8c190bdcbcc79f5fcf9ba1149bef2e0b
Jul 08 20:40:03.811412 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:03.811386    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-cx5g5_d9bac5f6-ba80-4473-aba3-ed383a637b3f/volume-data-source-validator/0.log"
Jul 08 20:40:04.400737 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:04.400699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8" event={"ID":"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc","Type":"ContainerStarted","Data":"af8695e346f1f9169523d8afc990860ccba69c7f7dee2270a981c37134df80a7"}
Jul 08 20:40:04.401168 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:04.400754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8" event={"ID":"1247ccb3-e7b3-4e72-a929-f7d6dfef57dc","Type":"ContainerStarted","Data":"c4e993c4fd1cb5ec6e17b655b3c18b1e8c190bdcbcc79f5fcf9ba1149bef2e0b"}
Jul 08 20:40:04.401168 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:04.400789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:04.417082 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:04.417031    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8" podStartSLOduration=1.417016207 podStartE2EDuration="1.417016207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 20:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 20:40:04.416003973 +0000 UTC m=+2410.627010596" watchObservedRunningTime="2026-07-08 20:40:04.417016207 +0000 UTC m=+2410.628022833"
Jul 08 20:40:04.866921 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:04.866893    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2x9jp_656f74cf-0962-49ad-84b0-7b49bddaf406/dns/0.log"
Jul 08 20:40:04.888962 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:04.888926    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2x9jp_656f74cf-0962-49ad-84b0-7b49bddaf406/kube-rbac-proxy/0.log"
Jul 08 20:40:05.029075 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:05.029045    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vxzk5_2dcbe74c-c83b-4c8c-8f27-301b2a346c64/dns-node-resolver/0.log"
Jul 08 20:40:05.641620 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:05.641587    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95ggm_ecb31af8-ee41-4f4b-9b7d-819c4606e4f9/node-ca/0.log"
Jul 08 20:40:06.584779 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:06.584748    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lh7zg_4492635f-c6ff-4351-b0ed-99caa488d8bc/istio-proxy/0.log"
Jul 08 20:40:06.704667 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:06.704636    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-789db8bf69-dhp7g_cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b/kube-auth-proxy/0.log"
Jul 08 20:40:06.761884 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:06.761854    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/0.log"
Jul 08 20:40:06.788369 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:06.788334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/1.log"
Jul 08 20:40:06.878179 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:06.878092    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dfd4t_c5e09a59-d18a-4663-a267-a62f788c5a14/payload-processing/0.log"
Jul 08 20:40:07.572725 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:07.572694    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m2rhg_69078ca8-87fd-444c-9383-8ba19d928474/serve-healthcheck-canary/0.log"
Jul 08 20:40:08.159683 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:08.159652    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sghd2_42e58975-3b19-496b-88d4-3cdd606358d7/kube-rbac-proxy/0.log"
Jul 08 20:40:08.182285 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:08.182255    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sghd2_42e58975-3b19-496b-88d4-3cdd606358d7/exporter/0.log"
Jul 08 20:40:08.203990 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:08.203959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sghd2_42e58975-3b19-496b-88d4-3cdd606358d7/extractor/0.log"
Jul 08 20:40:10.415467 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.415440    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9gq7f/perf-node-gather-daemonset-pkpl8"
Jul 08 20:40:10.453338 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.453291    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rhlnk_94a2c68d-b4ec-4687-bab1-711a55febffb/manager/0.log"
Jul 08 20:40:10.560171 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.560141    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4lr5z_67fbc7ab-b7cb-4b40-bbbf-c2697ffaa93d/manager/0.log"
Jul 08 20:40:10.644075 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.644039    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bbb8c8848-4dhnp_8bb2eea7-8292-4b85-8718-49aa801b3dee/manager/0.log"
Jul 08 20:40:10.664912 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.664886    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zs8mg_cd37a585-0296-40da-9982-9aae09a476bc/server/0.log"
Jul 08 20:40:10.728229 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.728140    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vdcbj_b6c60359-3796-449a-ac37-67f03fa68206/manager/0.log"
Jul 08 20:40:10.754033 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.754002    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67959458dc-fbfbs_2e3dfdfb-4cd6-4069-ab1b-433f1916ba65/manager/0.log"
Jul 08 20:40:10.775505 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:10.775477    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67959458dc-fbfbs_2e3dfdfb-4cd6-4069-ab1b-433f1916ba65/copy-manifests/0.log"
Jul 08 20:40:13.018259 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:13.018173    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lh7zg_4492635f-c6ff-4351-b0ed-99caa488d8bc/istio-proxy/0.log"
Jul 08 20:40:13.135774 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:13.135749    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-789db8bf69-dhp7g_cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b/kube-auth-proxy/0.log"
Jul 08 20:40:13.176942 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:13.176914    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/0.log"
Jul 08 20:40:13.204875 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:13.204847    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/1.log"
Jul 08 20:40:13.277904 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:13.277819    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dfd4t_c5e09a59-d18a-4663-a267-a62f788c5a14/payload-processing/0.log"
Jul 08 20:40:14.409305 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:14.409265    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678lh7zg_4492635f-c6ff-4351-b0ed-99caa488d8bc/istio-proxy/0.log"
Jul 08 20:40:14.513193 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:14.513168    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-789db8bf69-dhp7g_cabb46fd-ead9-4d76-8beb-ed4c65a5ea7b/kube-auth-proxy/0.log"
Jul 08 20:40:14.554569 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:14.554536    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/0.log"
Jul 08 20:40:14.583720 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:14.583688    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-57jjm_95b0d3dc-2826-4cf0-96e6-e17ad5549b67/istio-proxy/1.log"
Jul 08 20:40:14.658950 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:14.658914    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dfd4t_c5e09a59-d18a-4663-a267-a62f788c5a14/payload-processing/0.log"
Jul 08 20:40:17.305064 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:17.304988    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vl8qr_3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4/migrator/0.log"
Jul 08 20:40:17.327171 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:17.327145    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-vl8qr_3fad1ae9-d801-4cb5-b630-bc1b80c6d4a4/graceful-termination/0.log"
Jul 08 20:40:18.774635 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:18.774581    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-26kxm_386f2be3-d4b7-4036-9571-4ae75d74a937/kube-multus/0.log"
Jul 08 20:40:18.958467 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:18.958438    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/kube-multus-additional-cni-plugins/0.log"
Jul 08 20:40:18.980668 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:18.980639    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/egress-router-binary-copy/0.log"
Jul 08 20:40:19.001944 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.001920    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/cni-plugins/0.log"
Jul 08 20:40:19.023580 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.023554    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/bond-cni-plugin/0.log"
Jul 08 20:40:19.047256 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.047186    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/routeoverride-cni/0.log"
Jul 08 20:40:19.069513 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.069487    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/whereabouts-cni-bincopy/0.log"
Jul 08 20:40:19.090926 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.090902    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtwdx_7727a3af-2ec8-404c-8b42-72d979865c67/whereabouts-cni/0.log"
Jul 08 20:40:19.437733 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.437701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jmwmx_feb7733f-2a25-481b-8c31-9477c1e451cc/network-metrics-daemon/0.log"
Jul 08 20:40:19.458490 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:19.458466    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jmwmx_feb7733f-2a25-481b-8c31-9477c1e451cc/kube-rbac-proxy/0.log"
Jul 08 20:40:20.725475 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:20.725449    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8nf6_910c5708-6231-443a-8cc0-32f5cb580349/ovn-controller/0.log"
Jul 08 20:40:20.742713 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:20.742687    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8nf6_910c5708-6231-443a-8cc0-32f5cb580349/ovn-acl-logging/0.log"
Jul 08 20:40:20.767082 ip-10-0-136-70 kubenswrapper[2582]: I0708 20:40:20.767031    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s8nf6_910c5708-6231-443a-8cc0-32f5cb580349/kube-rbac-proxy-node/0.log"